You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@commons.apache.org by Ward <wa...@gmail.com> on 2009/03/04 13:17:03 UTC
[FILEUPLOAD] Problem with huge files (>2GB)
Hello,
I'm currently working on a web application which sould be able to deal
with large multimedia-files.
For uploading the files I'm using the Apache Commons FileUpload library.
This works great for files up to 2GB, but when I try it with files
larger than 2GB, things go wrong:
The upload doesn't start, in fact, the doPost()-method of the Servlet
which handles the upload-request is never called.
I think this might have something to do with the contentLength-property
of ServletRequest, which is an integer (so contentLengths > 2GB would
cause an overflow), but I'm not sure this is the problem.
So: is it true that the maximum size of a post to a servlet cannot
exceed 2GB?
And is there somenone who could giveme some hints about how to make it
possible to upload huge files? Files-sizes up to 50GB and more should be
supported (raw and un-encode videofiles that are)
Thanks in advance, you would really help me out!
Grtz
Ward (Belgium)
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org
Re: [FILEUPLOAD] Problem with huge files (>2GB)
Posted by Ward <wa...@gmail.com>.
Hi
I didn't set an file upload limit, so it uses the default (which is
unlimitted, and not 2GB)
I'm using a Tomcat serer, but I don't think the problem lies there...
(I set maxPostSize on 0 which means unlimited)
Grtz
Ward
Raghuveer.V schreef:
> I understand you have a problem of file upload size limit.
> Check the docs if it has defult size of 2 GGB.
> I used upload which is with struts.
> In struts which uses commons-upload ,the upload size can be controlled
> in struts-config.xml file
> <controller bufferSize="8192" maxFileSize="100K"
>
> Let us see if some one suggests a alternative solution.
>
>
>
> ----- Original Message ----- From: "Ward" <wa...@gmail.com>
> To: <us...@commons.apache.org>
> Sent: Wednesday, March 04, 2009 5:47 PM
> Subject: [FILEUPLOAD] Problem with huge files (>2GB)
>
>
>> Hello,
>>
>> I'm currently working on a web application which sould be able to deal
>> with large multimedia-files.
>> For uploading the files I'm using the Apache Commons FileUpload library.
>> This works great for files up to 2GB, but when I try it with files
>> larger than 2GB, things go wrong:
>> The upload doesn't start, in fact, the doPost()-method of the Servlet
>> which handles the upload-request is never called.
>>
>> I think this might have something to do with the contentLength-property
>> of ServletRequest, which is an integer (so contentLengths > 2GB would
>> cause an overflow), but I'm not sure this is the problem.
>>
>> So: is it true that the maximum size of a post to a servlet cannot
>> exceed 2GB?
>> And is there somenone who could giveme some hints about how to make it
>> possible to upload huge files? Files-sizes up to 50GB and more should be
>> supported (raw and un-encode videofiles that are)
>>
>> Thanks in advance, you would really help me out!
>>
>> Grtz
>>
>> Ward (Belgium)
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>> For additional commands, e-mail: user-help@commons.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> For additional commands, e-mail: user-help@commons.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org
RE: [FILEUPLOAD] Problem with huge files (>2GB)
Posted by Aaron Freeman <aa...@sendthisfile.com>.
Our company has an API you could use to send files that doesn't have a 2GB
limit. We also supply a client for Windows that makes it easy to use the
API. From your application you would just do an HTTP post to our file
manager (which runs as a daemon on your desktop), and it in turn transfers
the file with no size limit.
If that seems helpful or useful to you let me know and I can give you
details.
Aaron
www.SendThisFile.com
-----Original Message-----
From: Ward [mailto:wardlootens@gmail.com]
Sent: Wednesday, March 04, 2009 10:50 AM
To: Commons Users List
Subject: Re: [FILEUPLOAD] Problem with huge files (>2GB)
Well, I indeed stumbled upon this in a academical context (my master
thesis), but the application I'm developping actually has practical uses
(Media Asset Manament system, the uploaded files are raw and unencoded
video-files)
Perhaps I should try to split the files in pieces of less than 2GB, but
I think I will have to do this outside the browser (as no
client-side-technologies are able to access files, if I'm correct?)
And no, I didn't tried a 64-bit browser, cause I don't have any...
But I don't think that would be a practical solution anyway :)
Grtz
Ward
James Carman schreef:
> That might be academically interesting, but it's probably not a
> feasible user requirement.
>
> On Wed, Mar 4, 2009 at 11:34 AM, Paul Hussein <pa...@gmail.com>
wrote:
>> Have you tried a 64bit browser ?
>>
>> On Wed, Mar 4, 2009 at 5:32 PM, Paul Hussein <pa...@gmail.com>
wrote:
>>
>>> some interesting google hits
>>>
>>> Bottom points
>>> https://issues.apache.org/struts/browse/STR-2959
>>>
>>>
>>> http://www.motobit.com/help/scptutl/pa98.htm
>>>
>>> Lots of software uses integer and not a large integer, so they are
>>> inherently limited.
>>>
>>> I would use FTP for such large files.
>>>
>>>
>>>
>>> On Wed, Mar 4, 2009 at 3:45 PM, James Carman
<ja...@carmanconsulting.com>wrote:
>>>
>>>> Perhaps an applet (or webstarted application) and use Commons VFS to
>>>> move your files? We use Commons VFS over FTP (among other protocols)
>>>> and it works great. I only suggest VFS because it would be easy to
>>>> switch between transport mechanisms during unit testing (using local
>>>> files/directories during unit testing if need be or just mock
>>>> objects).
>>>>
>>>> On Wed, Mar 4, 2009 at 9:25 AM, Ward <wa...@gmail.com> wrote:
>>>>> Seems the problem lies in another place:
>>>>> modern browsers don't support uploads of 2GB and more
>>>>> (On Safari on windows I got to 4Gb, but that was the maximum there...)
>>>>>
>>>>> So I will have to find another solution...
>>>>>
>>>>> Grtz
>>>>>
>>>>> Ward
>>>>>
>>>>> Raghuveer.V schreef:
>>>>>> I understand you have a problem of file upload size limit.
>>>>>> Check the docs if it has defult size of 2 GGB.
>>>>>> I used upload which is with struts.
>>>>>> In struts which uses commons-upload ,the upload size can be
controlled
>>>> in
>>>>>> struts-config.xml file
>>>>>> <controller bufferSize="8192" maxFileSize="100K"
>>>>>>
>>>>>> Let us see if some one suggests a alternative solution.
>>>>>>
>>>>>>
>>>>>>
>>>>>> ----- Original Message ----- From: "Ward" <wa...@gmail.com>
>>>>>> To: <us...@commons.apache.org>
>>>>>> Sent: Wednesday, March 04, 2009 5:47 PM
>>>>>> Subject: [FILEUPLOAD] Problem with huge files (>2GB)
>>>>>>
>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>> I'm currently working on a web application which sould be able to
deal
>>>>>>> with large multimedia-files.
>>>>>>> For uploading the files I'm using the Apache Commons FileUpload
>>>> library.
>>>>>>> This works great for files up to 2GB, but when I try it with files
>>>>>>> larger than 2GB, things go wrong:
>>>>>>> The upload doesn't start, in fact, the doPost()-method of the
Servlet
>>>>>>> which handles the upload-request is never called.
>>>>>>>
>>>>>>> I think this might have something to do with the
>>>> contentLength-property
>>>>>>> of ServletRequest, which is an integer (so contentLengths > 2GB
would
>>>>>>> cause an overflow), but I'm not sure this is the problem.
>>>>>>>
>>>>>>> So: is it true that the maximum size of a post to a servlet cannot
>>>>>>> exceed 2GB?
>>>>>>> And is there somenone who could giveme some hints about how to make
it
>>>>>>> possible to upload huge files? Files-sizes up to 50GB and more
should
>>>> be
>>>>>>> supported (raw and un-encode videofiles that are)
>>>>>>>
>>>>>>> Thanks in advance, you would really help me out!
>>>>>>>
>>>>>>> Grtz
>>>>>>>
>>>>>>> Ward (Belgium)
>>>>>>>
>>>>>>>
>>>>>>>
---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>>>>>> For additional commands, e-mail: user-help@commons.apache.org
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>>>>> For additional commands, e-mail: user-help@commons.apache.org
>>>>>>
>>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>>>> For additional commands, e-mail: user-help@commons.apache.org
>>>>>
>>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>>> For additional commands, e-mail: user-help@commons.apache.org
>>>>
>>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> For additional commands, e-mail: user-help@commons.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org
No virus found in this incoming message.
Checked by AVG - www.avg.com
Version: 8.0.237 / Virus Database: 270.11.5/1977 - Release Date: 03/04/09
07:41:00
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org
Re: [FILEUPLOAD] Problem with huge files (>2GB)
Posted by Ward <wa...@gmail.com>.
Well, I indeed stumbled upon this in a academical context (my master
thesis), but the application I'm developping actually has practical uses
(Media Asset Manament system, the uploaded files are raw and unencoded
video-files)
Perhaps I should try to split the files in pieces of less than 2GB, but
I think I will have to do this outside the browser (as no
client-side-technologies are able to access files, if I'm correct?)
And no, I didn't tried a 64-bit browser, cause I don't have any...
But I don't think that would be a practical solution anyway :)
Grtz
Ward
James Carman schreef:
> That might be academically interesting, but it's probably not a
> feasible user requirement.
>
> On Wed, Mar 4, 2009 at 11:34 AM, Paul Hussein <pa...@gmail.com> wrote:
>> Have you tried a 64bit browser ?
>>
>> On Wed, Mar 4, 2009 at 5:32 PM, Paul Hussein <pa...@gmail.com> wrote:
>>
>>> some interesting google hits
>>>
>>> Bottom points
>>> https://issues.apache.org/struts/browse/STR-2959
>>>
>>>
>>> http://www.motobit.com/help/scptutl/pa98.htm
>>>
>>> Lots of software uses integer and not a large integer, so they are
>>> inherently limited.
>>>
>>> I would use FTP for such large files.
>>>
>>>
>>>
>>> On Wed, Mar 4, 2009 at 3:45 PM, James Carman <ja...@carmanconsulting.com>wrote:
>>>
>>>> Perhaps an applet (or webstarted application) and use Commons VFS to
>>>> move your files? We use Commons VFS over FTP (among other protocols)
>>>> and it works great. I only suggest VFS because it would be easy to
>>>> switch between transport mechanisms during unit testing (using local
>>>> files/directories during unit testing if need be or just mock
>>>> objects).
>>>>
>>>> On Wed, Mar 4, 2009 at 9:25 AM, Ward <wa...@gmail.com> wrote:
>>>>> Seems the problem lies in another place:
>>>>> modern browsers don't support uploads of 2GB and more
>>>>> (On Safari on windows I got to 4Gb, but that was the maximum there...)
>>>>>
>>>>> So I will have to find another solution...
>>>>>
>>>>> Grtz
>>>>>
>>>>> Ward
>>>>>
>>>>> Raghuveer.V schreef:
>>>>>> I understand you have a problem of file upload size limit.
>>>>>> Check the docs if it has defult size of 2 GGB.
>>>>>> I used upload which is with struts.
>>>>>> In struts which uses commons-upload ,the upload size can be controlled
>>>> in
>>>>>> struts-config.xml file
>>>>>> <controller bufferSize="8192" maxFileSize="100K"
>>>>>>
>>>>>> Let us see if some one suggests a alternative solution.
>>>>>>
>>>>>>
>>>>>>
>>>>>> ----- Original Message ----- From: "Ward" <wa...@gmail.com>
>>>>>> To: <us...@commons.apache.org>
>>>>>> Sent: Wednesday, March 04, 2009 5:47 PM
>>>>>> Subject: [FILEUPLOAD] Problem with huge files (>2GB)
>>>>>>
>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>> I'm currently working on a web application which sould be able to deal
>>>>>>> with large multimedia-files.
>>>>>>> For uploading the files I'm using the Apache Commons FileUpload
>>>> library.
>>>>>>> This works great for files up to 2GB, but when I try it with files
>>>>>>> larger than 2GB, things go wrong:
>>>>>>> The upload doesn't start, in fact, the doPost()-method of the Servlet
>>>>>>> which handles the upload-request is never called.
>>>>>>>
>>>>>>> I think this might have something to do with the
>>>> contentLength-property
>>>>>>> of ServletRequest, which is an integer (so contentLengths > 2GB would
>>>>>>> cause an overflow), but I'm not sure this is the problem.
>>>>>>>
>>>>>>> So: is it true that the maximum size of a post to a servlet cannot
>>>>>>> exceed 2GB?
>>>>>>> And is there somenone who could giveme some hints about how to make it
>>>>>>> possible to upload huge files? Files-sizes up to 50GB and more should
>>>> be
>>>>>>> supported (raw and un-encode videofiles that are)
>>>>>>>
>>>>>>> Thanks in advance, you would really help me out!
>>>>>>>
>>>>>>> Grtz
>>>>>>>
>>>>>>> Ward (Belgium)
>>>>>>>
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>>>>>> For additional commands, e-mail: user-help@commons.apache.org
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>>>>> For additional commands, e-mail: user-help@commons.apache.org
>>>>>>
>>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>>>> For additional commands, e-mail: user-help@commons.apache.org
>>>>>
>>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>>> For additional commands, e-mail: user-help@commons.apache.org
>>>>
>>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> For additional commands, e-mail: user-help@commons.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org
Re: [FILEUPLOAD] Problem with huge files (>2GB)
Posted by James Carman <ja...@carmanconsulting.com>.
That might be academically interesting, but it's probably not a
feasible user requirement.
On Wed, Mar 4, 2009 at 11:34 AM, Paul Hussein <pa...@gmail.com> wrote:
> Have you tried a 64bit browser ?
>
> On Wed, Mar 4, 2009 at 5:32 PM, Paul Hussein <pa...@gmail.com> wrote:
>
>> some interesting google hits
>>
>> Bottom points
>> https://issues.apache.org/struts/browse/STR-2959
>>
>>
>> http://www.motobit.com/help/scptutl/pa98.htm
>>
>> Lots of software uses integer and not a large integer, so they are
>> inherently limited.
>>
>> I would use FTP for such large files.
>>
>>
>>
>> On Wed, Mar 4, 2009 at 3:45 PM, James Carman <ja...@carmanconsulting.com>wrote:
>>
>>> Perhaps an applet (or webstarted application) and use Commons VFS to
>>> move your files? We use Commons VFS over FTP (among other protocols)
>>> and it works great. I only suggest VFS because it would be easy to
>>> switch between transport mechanisms during unit testing (using local
>>> files/directories during unit testing if need be or just mock
>>> objects).
>>>
>>> On Wed, Mar 4, 2009 at 9:25 AM, Ward <wa...@gmail.com> wrote:
>>> > Seems the problem lies in another place:
>>> > modern browsers don't support uploads of 2GB and more
>>> > (On Safari on windows I got to 4Gb, but that was the maximum there...)
>>> >
>>> > So I will have to find another solution...
>>> >
>>> > Grtz
>>> >
>>> > Ward
>>> >
>>> > Raghuveer.V schreef:
>>> >>
>>> >> I understand you have a problem of file upload size limit.
>>> >> Check the docs if it has defult size of 2 GGB.
>>> >> I used upload which is with struts.
>>> >> In struts which uses commons-upload ,the upload size can be controlled
>>> in
>>> >> struts-config.xml file
>>> >> <controller bufferSize="8192" maxFileSize="100K"
>>> >>
>>> >> Let us see if some one suggests a alternative solution.
>>> >>
>>> >>
>>> >>
>>> >> ----- Original Message ----- From: "Ward" <wa...@gmail.com>
>>> >> To: <us...@commons.apache.org>
>>> >> Sent: Wednesday, March 04, 2009 5:47 PM
>>> >> Subject: [FILEUPLOAD] Problem with huge files (>2GB)
>>> >>
>>> >>
>>> >>> Hello,
>>> >>>
>>> >>> I'm currently working on a web application which sould be able to deal
>>> >>> with large multimedia-files.
>>> >>> For uploading the files I'm using the Apache Commons FileUpload
>>> library.
>>> >>> This works great for files up to 2GB, but when I try it with files
>>> >>> larger than 2GB, things go wrong:
>>> >>> The upload doesn't start, in fact, the doPost()-method of the Servlet
>>> >>> which handles the upload-request is never called.
>>> >>>
>>> >>> I think this might have something to do with the
>>> contentLength-property
>>> >>> of ServletRequest, which is an integer (so contentLengths > 2GB would
>>> >>> cause an overflow), but I'm not sure this is the problem.
>>> >>>
>>> >>> So: is it true that the maximum size of a post to a servlet cannot
>>> >>> exceed 2GB?
>>> >>> And is there somenone who could giveme some hints about how to make it
>>> >>> possible to upload huge files? Files-sizes up to 50GB and more should
>>> be
>>> >>> supported (raw and un-encode videofiles that are)
>>> >>>
>>> >>> Thanks in advance, you would really help me out!
>>> >>>
>>> >>> Grtz
>>> >>>
>>> >>> Ward (Belgium)
>>> >>>
>>> >>>
>>> >>> ---------------------------------------------------------------------
>>> >>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>> >>> For additional commands, e-mail: user-help@commons.apache.org
>>> >>
>>> >>
>>> >> ---------------------------------------------------------------------
>>> >> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>> >> For additional commands, e-mail: user-help@commons.apache.org
>>> >>
>>> >>
>>> >
>>> > ---------------------------------------------------------------------
>>> > To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>> > For additional commands, e-mail: user-help@commons.apache.org
>>> >
>>> >
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>> For additional commands, e-mail: user-help@commons.apache.org
>>>
>>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org
Re: [FILEUPLOAD] Problem with huge files (>2GB)
Posted by Paul Hussein <pa...@gmail.com>.
Have you tried a 64bit browser ?
On Wed, Mar 4, 2009 at 5:32 PM, Paul Hussein <pa...@gmail.com> wrote:
> some interesting google hits
>
> Bottom points
> https://issues.apache.org/struts/browse/STR-2959
>
>
> http://www.motobit.com/help/scptutl/pa98.htm
>
> Lots of software uses integer and not a large integer, so they are
> inherently limited.
>
> I would use FTP for such large files.
>
>
>
> On Wed, Mar 4, 2009 at 3:45 PM, James Carman <ja...@carmanconsulting.com>wrote:
>
>> Perhaps an applet (or webstarted application) and use Commons VFS to
>> move your files? We use Commons VFS over FTP (among other protocols)
>> and it works great. I only suggest VFS because it would be easy to
>> switch between transport mechanisms during unit testing (using local
>> files/directories during unit testing if need be or just mock
>> objects).
>>
>> On Wed, Mar 4, 2009 at 9:25 AM, Ward <wa...@gmail.com> wrote:
>> > Seems the problem lies in another place:
>> > modern browsers don't support uploads of 2GB and more
>> > (On Safari on windows I got to 4Gb, but that was the maximum there...)
>> >
>> > So I will have to find another solution...
>> >
>> > Grtz
>> >
>> > Ward
>> >
>> > Raghuveer.V schreef:
>> >>
>> >> I understand you have a problem of file upload size limit.
>> >> Check the docs if it has defult size of 2 GGB.
>> >> I used upload which is with struts.
>> >> In struts which uses commons-upload ,the upload size can be controlled
>> in
>> >> struts-config.xml file
>> >> <controller bufferSize="8192" maxFileSize="100K"
>> >>
>> >> Let us see if some one suggests a alternative solution.
>> >>
>> >>
>> >>
>> >> ----- Original Message ----- From: "Ward" <wa...@gmail.com>
>> >> To: <us...@commons.apache.org>
>> >> Sent: Wednesday, March 04, 2009 5:47 PM
>> >> Subject: [FILEUPLOAD] Problem with huge files (>2GB)
>> >>
>> >>
>> >>> Hello,
>> >>>
>> >>> I'm currently working on a web application which sould be able to deal
>> >>> with large multimedia-files.
>> >>> For uploading the files I'm using the Apache Commons FileUpload
>> library.
>> >>> This works great for files up to 2GB, but when I try it with files
>> >>> larger than 2GB, things go wrong:
>> >>> The upload doesn't start, in fact, the doPost()-method of the Servlet
>> >>> which handles the upload-request is never called.
>> >>>
>> >>> I think this might have something to do with the
>> contentLength-property
>> >>> of ServletRequest, which is an integer (so contentLengths > 2GB would
>> >>> cause an overflow), but I'm not sure this is the problem.
>> >>>
>> >>> So: is it true that the maximum size of a post to a servlet cannot
>> >>> exceed 2GB?
>> >>> And is there somenone who could giveme some hints about how to make it
>> >>> possible to upload huge files? Files-sizes up to 50GB and more should
>> be
>> >>> supported (raw and un-encode videofiles that are)
>> >>>
>> >>> Thanks in advance, you would really help me out!
>> >>>
>> >>> Grtz
>> >>>
>> >>> Ward (Belgium)
>> >>>
>> >>>
>> >>> ---------------------------------------------------------------------
>> >>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>> >>> For additional commands, e-mail: user-help@commons.apache.org
>> >>
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>> >> For additional commands, e-mail: user-help@commons.apache.org
>> >>
>> >>
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>> > For additional commands, e-mail: user-help@commons.apache.org
>> >
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>> For additional commands, e-mail: user-help@commons.apache.org
>>
>>
>
Re: [FILEUPLOAD] Problem with huge files (>2GB)
Posted by Paul Hussein <pa...@gmail.com>.
some interesting google hits
Bottom points
https://issues.apache.org/struts/browse/STR-2959
http://www.motobit.com/help/scptutl/pa98.htm
Lots of software uses integer and not a large integer, so they are
inherently limited.
I would use FTP for such large files.
On Wed, Mar 4, 2009 at 3:45 PM, James Carman <ja...@carmanconsulting.com>wrote:
> Perhaps an applet (or webstarted application) and use Commons VFS to
> move your files? We use Commons VFS over FTP (among other protocols)
> and it works great. I only suggest VFS because it would be easy to
> switch between transport mechanisms during unit testing (using local
> files/directories during unit testing if need be or just mock
> objects).
>
> On Wed, Mar 4, 2009 at 9:25 AM, Ward <wa...@gmail.com> wrote:
> > Seems the problem lies in another place:
> > modern browsers don't support uploads of 2GB and more
> > (On Safari on windows I got to 4Gb, but that was the maximum there...)
> >
> > So I will have to find another solution...
> >
> > Grtz
> >
> > Ward
> >
> > Raghuveer.V schreef:
> >>
> >> I understand you have a problem of file upload size limit.
> >> Check the docs if it has defult size of 2 GGB.
> >> I used upload which is with struts.
> >> In struts which uses commons-upload ,the upload size can be controlled
> in
> >> struts-config.xml file
> >> <controller bufferSize="8192" maxFileSize="100K"
> >>
> >> Let us see if some one suggests a alternative solution.
> >>
> >>
> >>
> >> ----- Original Message ----- From: "Ward" <wa...@gmail.com>
> >> To: <us...@commons.apache.org>
> >> Sent: Wednesday, March 04, 2009 5:47 PM
> >> Subject: [FILEUPLOAD] Problem with huge files (>2GB)
> >>
> >>
> >>> Hello,
> >>>
> >>> I'm currently working on a web application which sould be able to deal
> >>> with large multimedia-files.
> >>> For uploading the files I'm using the Apache Commons FileUpload
> library.
> >>> This works great for files up to 2GB, but when I try it with files
> >>> larger than 2GB, things go wrong:
> >>> The upload doesn't start, in fact, the doPost()-method of the Servlet
> >>> which handles the upload-request is never called.
> >>>
> >>> I think this might have something to do with the contentLength-property
> >>> of ServletRequest, which is an integer (so contentLengths > 2GB would
> >>> cause an overflow), but I'm not sure this is the problem.
> >>>
> >>> So: is it true that the maximum size of a post to a servlet cannot
> >>> exceed 2GB?
> >>> And is there somenone who could giveme some hints about how to make it
> >>> possible to upload huge files? Files-sizes up to 50GB and more should
> be
> >>> supported (raw and un-encode videofiles that are)
> >>>
> >>> Thanks in advance, you would really help me out!
> >>>
> >>> Grtz
> >>>
> >>> Ward (Belgium)
> >>>
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> >>> For additional commands, e-mail: user-help@commons.apache.org
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> >> For additional commands, e-mail: user-help@commons.apache.org
> >>
> >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> > For additional commands, e-mail: user-help@commons.apache.org
> >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> For additional commands, e-mail: user-help@commons.apache.org
>
>
Re: [FILEUPLOAD] Problem with huge files (>2GB)
Posted by James Carman <ja...@carmanconsulting.com>.
Perhaps an applet (or webstarted application) and use Commons VFS to
move your files? We use Commons VFS over FTP (among other protocols)
and it works great. I only suggest VFS because it would be easy to
switch between transport mechanisms during unit testing (using local
files/directories during unit testing if need be or just mock
objects).
On Wed, Mar 4, 2009 at 9:25 AM, Ward <wa...@gmail.com> wrote:
> Seems the problem lies in another place:
> modern browsers don't support uploads of 2GB and more
> (On Safari on windows I got to 4Gb, but that was the maximum there...)
>
> So I will have to find another solution...
>
> Grtz
>
> Ward
>
> Raghuveer.V schreef:
>>
>> I understand you have a problem of file upload size limit.
>> Check the docs if it has defult size of 2 GGB.
>> I used upload which is with struts.
>> In struts which uses commons-upload ,the upload size can be controlled in
>> struts-config.xml file
>> <controller bufferSize="8192" maxFileSize="100K"
>>
>> Let us see if some one suggests a alternative solution.
>>
>>
>>
>> ----- Original Message ----- From: "Ward" <wa...@gmail.com>
>> To: <us...@commons.apache.org>
>> Sent: Wednesday, March 04, 2009 5:47 PM
>> Subject: [FILEUPLOAD] Problem with huge files (>2GB)
>>
>>
>>> Hello,
>>>
>>> I'm currently working on a web application which sould be able to deal
>>> with large multimedia-files.
>>> For uploading the files I'm using the Apache Commons FileUpload library.
>>> This works great for files up to 2GB, but when I try it with files
>>> larger than 2GB, things go wrong:
>>> The upload doesn't start, in fact, the doPost()-method of the Servlet
>>> which handles the upload-request is never called.
>>>
>>> I think this might have something to do with the contentLength-property
>>> of ServletRequest, which is an integer (so contentLengths > 2GB would
>>> cause an overflow), but I'm not sure this is the problem.
>>>
>>> So: is it true that the maximum size of a post to a servlet cannot
>>> exceed 2GB?
>>> And is there somenone who could giveme some hints about how to make it
>>> possible to upload huge files? Files-sizes up to 50GB and more should be
>>> supported (raw and un-encode videofiles that are)
>>>
>>> Thanks in advance, you would really help me out!
>>>
>>> Grtz
>>>
>>> Ward (Belgium)
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>>> For additional commands, e-mail: user-help@commons.apache.org
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>> For additional commands, e-mail: user-help@commons.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> For additional commands, e-mail: user-help@commons.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org
Re: [FILEUPLOAD] Problem with huge files (>2GB)
Posted by Ward <wa...@gmail.com>.
Seems the problem lies in another place:
modern browsers don't support uploads of 2GB and more
(On Safari on windows I got to 4Gb, but that was the maximum there...)
So I will have to find another solution...
Grtz
Ward
Raghuveer.V schreef:
> I understand you have a problem of file upload size limit.
> Check the docs if it has defult size of 2 GGB.
> I used upload which is with struts.
> In struts which uses commons-upload ,the upload size can be controlled
> in struts-config.xml file
> <controller bufferSize="8192" maxFileSize="100K"
>
> Let us see if some one suggests a alternative solution.
>
>
>
> ----- Original Message ----- From: "Ward" <wa...@gmail.com>
> To: <us...@commons.apache.org>
> Sent: Wednesday, March 04, 2009 5:47 PM
> Subject: [FILEUPLOAD] Problem with huge files (>2GB)
>
>
>> Hello,
>>
>> I'm currently working on a web application which sould be able to deal
>> with large multimedia-files.
>> For uploading the files I'm using the Apache Commons FileUpload library.
>> This works great for files up to 2GB, but when I try it with files
>> larger than 2GB, things go wrong:
>> The upload doesn't start, in fact, the doPost()-method of the Servlet
>> which handles the upload-request is never called.
>>
>> I think this might have something to do with the contentLength-property
>> of ServletRequest, which is an integer (so contentLengths > 2GB would
>> cause an overflow), but I'm not sure this is the problem.
>>
>> So: is it true that the maximum size of a post to a servlet cannot
>> exceed 2GB?
>> And is there somenone who could giveme some hints about how to make it
>> possible to upload huge files? Files-sizes up to 50GB and more should be
>> supported (raw and un-encode videofiles that are)
>>
>> Thanks in advance, you would really help me out!
>>
>> Grtz
>>
>> Ward (Belgium)
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
>> For additional commands, e-mail: user-help@commons.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> For additional commands, e-mail: user-help@commons.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org
Re: [FILEUPLOAD] Problem with huge files (>2GB)
Posted by "Raghuveer.V" <ra...@infotechsw.com>.
I understand you have a problem of file upload size limit.
Check the docs if it has defult size of 2 GGB.
I used upload which is with struts.
In struts which uses commons-upload ,the upload size can be controlled in
struts-config.xml file
<controller bufferSize="8192" maxFileSize="100K"
Let us see if some one suggests a alternative solution.
----- Original Message -----
From: "Ward" <wa...@gmail.com>
To: <us...@commons.apache.org>
Sent: Wednesday, March 04, 2009 5:47 PM
Subject: [FILEUPLOAD] Problem with huge files (>2GB)
> Hello,
>
> I'm currently working on a web application which sould be able to deal
> with large multimedia-files.
> For uploading the files I'm using the Apache Commons FileUpload library.
> This works great for files up to 2GB, but when I try it with files
> larger than 2GB, things go wrong:
> The upload doesn't start, in fact, the doPost()-method of the Servlet
> which handles the upload-request is never called.
>
> I think this might have something to do with the contentLength-property
> of ServletRequest, which is an integer (so contentLengths > 2GB would
> cause an overflow), but I'm not sure this is the problem.
>
> So: is it true that the maximum size of a post to a servlet cannot
> exceed 2GB?
> And is there somenone who could giveme some hints about how to make it
> possible to upload huge files? Files-sizes up to 50GB and more should be
> supported (raw and un-encode videofiles that are)
>
> Thanks in advance, you would really help me out!
>
> Grtz
>
> Ward (Belgium)
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
> For additional commands, e-mail: user-help@commons.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@commons.apache.org
For additional commands, e-mail: user-help@commons.apache.org