You are viewing a plain text version of this content. The canonical link for it is here.
Posted to slide-dev@jakarta.apache.org by Sven Pfeiffer <sv...@innoface.de> on 2005/01/07 14:33:40 UTC
file size limitation in slide 2.1 final
Hi List
there seems to be a limitation of the file site in slide 2.1 final.
no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files they are simply
cut.
Is there a way to avoid this?
thanks in advance
SVen
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: file size limitation in slide 2.1 final
Posted by Oliver Zeigermann <ol...@gmail.com>.
On Thu, 27 Jan 2005 16:11:39 +0100, Sven Pfeiffer
<sv...@innoface.de> wrote:
> it must happen somewhere in
>
> NodeRevisionContent.bufferContent(InputStrem in), because this method returns the "wrong" value.
Not necessarily. If the body already has the wrong size - which I suspect.
Oliver
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
RE: file size limitation in slide 2.1 final
Posted by Sven Pfeiffer <sv...@innoface.de>.
it must happen somewhere in
NodeRevisionContent.bufferContent(InputStrem in), because this method returns the "wrong" value.
I am trying to find where exactly it happens and submit a patch if I found it.
thank you for your help and hints
>-----Original Message-----
>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>Sent: Thursday, January 27, 2005 3:57 PM
>To: Slide Developers Mailing List
>Subject: Re: file size limitation in slide 2.1 final
>
>
>No, as you correctly analyzed before the length is determined using
>req.getContentLength() which of course is wrong when larger then 2GB.
>So, this is likely to be the problem. Would you try setting it with
>req.getHeader("content-length")?
>
>If this does not help and the web container delivers the correct
>request body then the last resort is to step through Slide from the
>PUT request to the store level in a debugger. Doing this you *will*
>find the problem, but it will take time :( If you submitted a patch
>then I would happily commit it to Slide.
>
>Good luck,
>
>Oliver
>
>
>On Thu, 27 Jan 2005 13:37:30 +0100, Sven Pfeiffer
><sv...@innoface.de> wrote:
>> I just continued trying and something strange happend.
>>
>> when trying to upload a file with 4 GB,using webfolders, the content length is not correct.
>>
>> but when using DAVExplorer the content-length is delivered correct (if read from req.getHeader("content-length")).
>>
>> But still only the first 280 MB of the 4GB file are uploaded, but I think this is because there is somewhere another int
>in Slide?!
>>
>> I am trying to find it.
>>
>> Thanks for your help
>>
>> SVen
>>
>> >-----Original Message-----
>> >From: Sven Pfeiffer [mailto:sven.pfeiffer@innoface.de]
>> >Sent: Thursday, January 27, 2005 10:40 AM
>> >To: Slide Developers Mailing List; ozeigermann@apache.org
>> >Subject: RE: file size limitation in slide 2.1 final
>> >
>> >
>> >Hello Oliver
>> >
>> >how can I get the amount of data copied?
>> >
>> >I tried to read the content-length directly from request-objects header
>(Long.valueOf(req.getHeader("content-length")).longValue())
>> >and this seems to return the correct length, so I guess it is no limitation inside the web container, what do you think?
>> >
>> >thanks in advance
>> >SVen
>> >
>> >
>> >
>> >>-----Original Message-----
>> >>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >>Sent: Wednesday, January 26, 2005 5:16 PM
>> >>To: Slide Developers Mailing List
>> >>Subject: Re: file size limitation in slide 2.1 final
>> >>
>> >>
>> >>That's bad news :(
>> >>
>> >>Sounds like a limitation inside the web container (Tomcat?) then.
>> >>Seems that request bodies longer than 2GB are not even passed properly
>> >>to the application. Could you verify this, e.g. by adding output for
>> >>the actual amount of data copied in the PutMethod lines 421 and 244?
>> >>
>> >>If so, maybe changing the web container or upgrading to a more recent
>> >>version of it could help.
>> >>
>> >>Oliver
>> >>
>> >>On Wed, 26 Jan 2005 16:05:06 +0100, Sven Pfeiffer
>> >><sv...@innoface.de> wrote:
>> >>> thank you again for your fast help.
>> >>>
>> >>> now i'm no longer getting exceptions on the server, but the file is still not uploaded.
>> >>> a file with the name is created, and 201 "Created" is printed on the server, but there is no content, the size is 0 kb.
>> >>>
>> >>> Files smaller then 2 GB are copied normal.
>> >>>
>> >>> >-----Original Message-----
>> >>> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >>>
>> >>> >Sent: Wednesday, January 26, 2005 2:40 PM
>> >>> >To: Slide Developers Mailing List
>> >>> >Subject: Re: file size limitation in slide 2.1 final
>> >>> >
>> >>> >
>> >>> >Agreed. However, I have just committed a fix that should allow you to
>> >>> >store files of any size. The stream is streamed to a file first and
>> >>> >the amount of bytes copied now correctly is stored into a long instead
>> >>> >of an int.
>> >>> >
>> >>> >You will need to have
>> >>> >
>> >>> > <parameter name="repeat-upon-conflict">true</parameter>
>> >>> >
>> >>> >in your configuration section which is the case in the default Domain.xml.
>> >>> >
>> >>> >Please try it, maybe it helps.
>> >>> >
>> >>> >Oliver
>> >>> >
>> >>> >On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer
>> >>> ><sv...@innoface.de> wrote:
>> >>> >> if I am right, I am in trouble.
>> >>> >>
>> >>> >> I just tried to find out where the problem was and found that the size of the file is read from
>> >>> >> javax.servlet.http.HttpServletRequests getContentLength()-Method which returns an int.
>> >>> >>
>> >>> >> and if the file is larger then 2 GB the maximum capacity of int is exceeded and so it is -xyz.
>> >>> >>
>> >>> >> that would explain why it seemed to work with the 4GB-file because then we are back in the positiv range and so it
>> >>> >stores the file.
>> >>> >>
>> >>> >> What do you think?
>> >>> >> Am I right with this?
>> >>> >>
>> >>> >> Thanks in advance
>> >>> >>
>> >>> >> >-----Original Message-----
>> >>> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >>> >>
>> >>> >> >Sent: Wednesday, January 26, 2005 9:04 AM
>> >>> >> >To: Slide Developers Mailing List
>> >>> >> >Subject: Re: file size limitation in slide 2.1 final
>> >>> >> >
>> >>> >> >
>> >>> >> >Does a file that is a bit smaller than 2 GB work? If so maybe there
>> >>> >> >are places inside the Slide code that use integers which can only
>> >>> >> >represent up to 2 GB...
>> >>> >> >
>> >>> >> >Oliver
>> >>> >> >
>> >>> >> >
>> >>> >> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
>> >>> >> ><sv...@innoface.de> wrote:
>> >>> >> >> Hello again,
>> >>> >> >>
>> >>> >> >> I just tried it again.
>> >>> >> >>
>> >>> >> >> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
>> >>> >> >>
>> >>> >> >> Again I tried to put a large file (>4 GB), I am getting
>> >>> >> >>
>> >>> >> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
>> >>> >> >>
>> >>> >> >> and the file is created, but it has just 287 MB.
>> >>> >> >>
>> >>> >> >> When trying to put a smaller file (780 MB) everything works fine.
>> >>> >> >>
>> >>> >> >> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum
>filesize of NTFS
>> >>> >> >is about 16
>> >>> >> >> EB or so.
>> >>> >> >>
>> >>> >> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the
>> >org.apache.slide.store.txfile.TxFileContentStore.
>> >>> >> >>
>> >>> >> >> And I put the file on it using WindowsXPs netfolders.
>> >>> >> >>
>> >>> >> >> Has anyone an idea why I can't upload larger files?
>> >>> >> >>
>> >>> >> >> thanks in advance
>> >>> >> >> SVen
>> >>> >> >>
>> >>> >> >> >-----Original Message-----
>> >>> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >>> >> >>
>> >>> >> >> >Sent: Friday, January 07, 2005 3:21 PM
>> >>> >> >> >To: Sven Pfeiffer
>> >>> >> >> >Cc: Slide Developers Mailing List
>> >>> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >>> >> >> >
>> >>> >> >> >
>> >>> >> >> >OK, I just tried it with my installation (built from Slide head,
>> >>> >> >> >however) and I just copied a file more than 600MB long and it worked.
>> >>> >> >> >
>> >>> >> >> >What I have seen from the 2.1 sources is that when the client does not
>> >>> >> >> >pass the content length, the whole file is buffered in memory to find
>> >>> >> >> >it out. This is different in the Slide head.
>> >>> >> >> >
>> >>> >> >> >I did my test with Windows web folders which correctly passes the length anyway.
>> >>> >> >> >
>> >>> >> >> >Maybe this is somewhat related to your problem?
>> >>> >> >> >
>> >>> >> >> >Oliver
>> >>> >> >> >
>> >>> >> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
>> >>> >> >> ><sv...@innoface.de> wrote:
>> >>> >> >> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after
>refresh it shows
>> >>> >> >> >the real size
>> >>> >> >> >> 561 MB which is also shown on the server.
>> >>> >> >> >>
>> >>> >> >> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than
>> >it stops.
>> >>> >> >> >the client
>> >>> >> >> >> seems to continue copying for about 5 minutes.
>> >>> >> >> >>
>> >>> >> >> >> the system returns 201 (created)
>> >>> >> >> >>
>> >>> >> >> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
>> >>> >> >> >>
>> >>> >> >> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
>> >>> >> >> >>
>> >>> >> >> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
>> >>> >> >> >>
>> >>> >> >> >> thank you for your support
>> >>> >> >> >>
>> >>> >> >> >> SVen
>> >>> >> >> >>
>> >>> >> >> >> >-----Original Message-----
>> >>> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >>> >> >> >> >Sent: Friday, January 07, 2005 2:50 PM
>> >>> >> >> >> >To: Sven Pfeiffer
>> >>> >> >> >> >Cc: Slide Developers Mailing List
>> >>> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >>> >> >> >> >
>> >>> >> >> >> >
>> >>> >> >> >> >What do the properties say? The original size? Does your file system
>> >>> >> >> >> >support larger files?
>> >>> >> >> >> >
>> >>> >> >> >> >Oliver
>> >>> >> >> >> >
>> >>> >> >> >> >
>> >>> >> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
>> >>> >> >> >> ><sv...@innoface.de> wrote:
>> >>> >> >> >> >> TxFileContentStore
>> >>> >> >> >> >>
>> >>> >> >> >> >>
>> >>> >> >> >> >> >-----Original Message-----
>> >>> >> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >>> >> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM
>> >>> >> >> >> >> >To: Slide Developers Mailing List
>> >>> >> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >>> >> >> >> >> >
>> >>> >> >> >> >> >
>> >>> >> >> >> >> >Which store?
>> >>> >> >> >> >> >
>> >>> >> >> >> >> >Oliver
>> >>> >> >> >> >> >
>> >>> >> >> >> >> >
>> >>> >> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
>> >>> >> >> >> >> ><sv...@innoface.de> wrote:
>> >>> >> >> >> >> >> Hi List
>> >>> >> >> >> >> >>
>> >>> >> >> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
>> >>> >> >> >> >> >>
>> >>> >> >> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store
>larger files
>> >>> >> >> >> >they are simply
>> >>> >> >> >> >> >> cut.
>> >>> >> >> >> >> >>
>> >>> >> >> >> >> >> Is there a way to avoid this?
>> >>> >> >> >> >> >>
>> >>> >> >> >> >> >> thanks in advance
>> >>> >> >> >> >> >>
>> >>> >> >> >> >> >> SVen
>> >>> >> >> >> >> >>
>> >>> >> >> >> >> >> ---------------------------------------------------------------------
>> >>> >> >> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >>> >> >> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>> >> >> >> >> >>
>> >>> >> >> >> >> >>
>> >>> >> >> >> >> >
>> >>> >> >> >> >> >---------------------------------------------------------------------
>> >>> >> >> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >>> >> >> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>> >> >> >> >> >
>> >>> >> >> >> >>
>> >>> >> >> >> >>
>> >>> >> >> >>
>> >>> >> >> >>
>> >>> >> >> >
>> >>> >> >> >---------------------------------------------------------------------
>> >>> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >>> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>> >> >> >
>> >>> >> >>
>> >>> >> >> ---------------------------------------------------------------------
>> >>> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >>> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>> >> >>
>> >>> >> >>
>> >>> >> >
>> >>> >> >---------------------------------------------------------------------
>> >>> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >>> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>> >> >
>> >>> >>
>> >>> >> ---------------------------------------------------------------------
>> >>> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >>> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>> >>
>> >>> >>
>> >>> >
>> >>> >---------------------------------------------------------------------
>> >>> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >>> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>> >
>> >>>
>> >>> ---------------------------------------------------------------------
>> >>> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >>> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>>
>> >>>
>> >>
>> >>---------------------------------------------------------------------
>> >>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>
>> >
>> >
>> >---------------------------------------------------------------------
>> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>
>>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: file size limitation in slide 2.1 final
Posted by Oliver Zeigermann <ol...@gmail.com>.
No, as you correctly analyzed before the length is determined using
req.getContentLength() which of course is wrong when larger then 2GB.
So, this is likely to be the problem. Would you try setting it with
req.getHeader("content-length")?
If this does not help and the web container delivers the correct
request body then the last resort is to step through Slide from the
PUT request to the store level in a debugger. Doing this you *will*
find the problem, but it will take time :( If you submitted a patch
then I would happily commit it to Slide.
Good luck,
Oliver
On Thu, 27 Jan 2005 13:37:30 +0100, Sven Pfeiffer
<sv...@innoface.de> wrote:
> I just continued trying and something strange happend.
>
> when trying to upload a file with 4 GB,using webfolders, the content length is not correct.
>
> but when using DAVExplorer the content-length is delivered correct (if read from req.getHeader("content-length")).
>
> But still only the first 280 MB of the 4GB file are uploaded, but I think this is because there is somewhere another int in Slide?!
>
> I am trying to find it.
>
> Thanks for your help
>
> SVen
>
> >-----Original Message-----
> >From: Sven Pfeiffer [mailto:sven.pfeiffer@innoface.de]
> >Sent: Thursday, January 27, 2005 10:40 AM
> >To: Slide Developers Mailing List; ozeigermann@apache.org
> >Subject: RE: file size limitation in slide 2.1 final
> >
> >
> >Hello Oliver
> >
> >how can I get the amount of data copied?
> >
> >I tried to read the content-length directly from request-objects header (Long.valueOf(req.getHeader("content-length")).longValue())
> >and this seems to return the correct length, so I guess it is no limitation inside the web container, what do you think?
> >
> >thanks in advance
> >SVen
> >
> >
> >
> >>-----Original Message-----
> >>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >>Sent: Wednesday, January 26, 2005 5:16 PM
> >>To: Slide Developers Mailing List
> >>Subject: Re: file size limitation in slide 2.1 final
> >>
> >>
> >>That's bad news :(
> >>
> >>Sounds like a limitation inside the web container (Tomcat?) then.
> >>Seems that request bodies longer than 2GB are not even passed properly
> >>to the application. Could you verify this, e.g. by adding output for
> >>the actual amount of data copied in the PutMethod lines 421 and 244?
> >>
> >>If so, maybe changing the web container or upgrading to a more recent
> >>version of it could help.
> >>
> >>Oliver
> >>
> >>On Wed, 26 Jan 2005 16:05:06 +0100, Sven Pfeiffer
> >><sv...@innoface.de> wrote:
> >>> thank you again for your fast help.
> >>>
> >>> now i'm no longer getting exceptions on the server, but the file is still not uploaded.
> >>> a file with the name is created, and 201 "Created" is printed on the server, but there is no content, the size is 0 kb.
> >>>
> >>> Files smaller then 2 GB are copied normal.
> >>>
> >>> >-----Original Message-----
> >>> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >>>
> >>> >Sent: Wednesday, January 26, 2005 2:40 PM
> >>> >To: Slide Developers Mailing List
> >>> >Subject: Re: file size limitation in slide 2.1 final
> >>> >
> >>> >
> >>> >Agreed. However, I have just committed a fix that should allow you to
> >>> >store files of any size. The stream is streamed to a file first and
> >>> >the amount of bytes copied now correctly is stored into a long instead
> >>> >of an int.
> >>> >
> >>> >You will need to have
> >>> >
> >>> > <parameter name="repeat-upon-conflict">true</parameter>
> >>> >
> >>> >in your configuration section which is the case in the default Domain.xml.
> >>> >
> >>> >Please try it, maybe it helps.
> >>> >
> >>> >Oliver
> >>> >
> >>> >On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer
> >>> ><sv...@innoface.de> wrote:
> >>> >> if I am right, I am in trouble.
> >>> >>
> >>> >> I just tried to find out where the problem was and found that the size of the file is read from
> >>> >> javax.servlet.http.HttpServletRequests getContentLength()-Method which returns an int.
> >>> >>
> >>> >> and if the file is larger then 2 GB the maximum capacity of int is exceeded and so it is -xyz.
> >>> >>
> >>> >> that would explain why it seemed to work with the 4GB-file because then we are back in the positiv range and so it
> >>> >stores the file.
> >>> >>
> >>> >> What do you think?
> >>> >> Am I right with this?
> >>> >>
> >>> >> Thanks in advance
> >>> >>
> >>> >> >-----Original Message-----
> >>> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >>> >>
> >>> >> >Sent: Wednesday, January 26, 2005 9:04 AM
> >>> >> >To: Slide Developers Mailing List
> >>> >> >Subject: Re: file size limitation in slide 2.1 final
> >>> >> >
> >>> >> >
> >>> >> >Does a file that is a bit smaller than 2 GB work? If so maybe there
> >>> >> >are places inside the Slide code that use integers which can only
> >>> >> >represent up to 2 GB...
> >>> >> >
> >>> >> >Oliver
> >>> >> >
> >>> >> >
> >>> >> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
> >>> >> ><sv...@innoface.de> wrote:
> >>> >> >> Hello again,
> >>> >> >>
> >>> >> >> I just tried it again.
> >>> >> >>
> >>> >> >> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
> >>> >> >>
> >>> >> >> Again I tried to put a large file (>4 GB), I am getting
> >>> >> >>
> >>> >> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
> >>> >> >>
> >>> >> >> and the file is created, but it has just 287 MB.
> >>> >> >>
> >>> >> >> When trying to put a smaller file (780 MB) everything works fine.
> >>> >> >>
> >>> >> >> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS
> >>> >> >is about 16
> >>> >> >> EB or so.
> >>> >> >>
> >>> >> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the
> >org.apache.slide.store.txfile.TxFileContentStore.
> >>> >> >>
> >>> >> >> And I put the file on it using WindowsXPs netfolders.
> >>> >> >>
> >>> >> >> Has anyone an idea why I can't upload larger files?
> >>> >> >>
> >>> >> >> thanks in advance
> >>> >> >> SVen
> >>> >> >>
> >>> >> >> >-----Original Message-----
> >>> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >>> >> >>
> >>> >> >> >Sent: Friday, January 07, 2005 3:21 PM
> >>> >> >> >To: Sven Pfeiffer
> >>> >> >> >Cc: Slide Developers Mailing List
> >>> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >>> >> >> >
> >>> >> >> >
> >>> >> >> >OK, I just tried it with my installation (built from Slide head,
> >>> >> >> >however) and I just copied a file more than 600MB long and it worked.
> >>> >> >> >
> >>> >> >> >What I have seen from the 2.1 sources is that when the client does not
> >>> >> >> >pass the content length, the whole file is buffered in memory to find
> >>> >> >> >it out. This is different in the Slide head.
> >>> >> >> >
> >>> >> >> >I did my test with Windows web folders which correctly passes the length anyway.
> >>> >> >> >
> >>> >> >> >Maybe this is somewhat related to your problem?
> >>> >> >> >
> >>> >> >> >Oliver
> >>> >> >> >
> >>> >> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
> >>> >> >> ><sv...@innoface.de> wrote:
> >>> >> >> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
> >>> >> >> >the real size
> >>> >> >> >> 561 MB which is also shown on the server.
> >>> >> >> >>
> >>> >> >> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than
> >it stops.
> >>> >> >> >the client
> >>> >> >> >> seems to continue copying for about 5 minutes.
> >>> >> >> >>
> >>> >> >> >> the system returns 201 (created)
> >>> >> >> >>
> >>> >> >> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
> >>> >> >> >>
> >>> >> >> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
> >>> >> >> >>
> >>> >> >> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
> >>> >> >> >>
> >>> >> >> >> thank you for your support
> >>> >> >> >>
> >>> >> >> >> SVen
> >>> >> >> >>
> >>> >> >> >> >-----Original Message-----
> >>> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >>> >> >> >> >Sent: Friday, January 07, 2005 2:50 PM
> >>> >> >> >> >To: Sven Pfeiffer
> >>> >> >> >> >Cc: Slide Developers Mailing List
> >>> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >>> >> >> >> >
> >>> >> >> >> >
> >>> >> >> >> >What do the properties say? The original size? Does your file system
> >>> >> >> >> >support larger files?
> >>> >> >> >> >
> >>> >> >> >> >Oliver
> >>> >> >> >> >
> >>> >> >> >> >
> >>> >> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
> >>> >> >> >> ><sv...@innoface.de> wrote:
> >>> >> >> >> >> TxFileContentStore
> >>> >> >> >> >>
> >>> >> >> >> >>
> >>> >> >> >> >> >-----Original Message-----
> >>> >> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >>> >> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM
> >>> >> >> >> >> >To: Slide Developers Mailing List
> >>> >> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >>> >> >> >> >> >
> >>> >> >> >> >> >
> >>> >> >> >> >> >Which store?
> >>> >> >> >> >> >
> >>> >> >> >> >> >Oliver
> >>> >> >> >> >> >
> >>> >> >> >> >> >
> >>> >> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
> >>> >> >> >> >> ><sv...@innoface.de> wrote:
> >>> >> >> >> >> >> Hi List
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
> >>> >> >> >> >they are simply
> >>> >> >> >> >> >> cut.
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> Is there a way to avoid this?
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> thanks in advance
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> SVen
> >>> >> >> >> >> >>
> >>> >> >> >> >> >> ---------------------------------------------------------------------
> >>> >> >> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >>> >> >> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>> >> >> >> >> >>
> >>> >> >> >> >> >>
> >>> >> >> >> >> >
> >>> >> >> >> >> >---------------------------------------------------------------------
> >>> >> >> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >>> >> >> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>> >> >> >> >> >
> >>> >> >> >> >>
> >>> >> >> >> >>
> >>> >> >> >>
> >>> >> >> >>
> >>> >> >> >
> >>> >> >> >---------------------------------------------------------------------
> >>> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >>> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>> >> >> >
> >>> >> >>
> >>> >> >> ---------------------------------------------------------------------
> >>> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >>> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>> >> >>
> >>> >> >>
> >>> >> >
> >>> >> >---------------------------------------------------------------------
> >>> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >>> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>> >> >
> >>> >>
> >>> >> ---------------------------------------------------------------------
> >>> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >>> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>> >>
> >>> >>
> >>> >
> >>> >---------------------------------------------------------------------
> >>> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >>> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>> >
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >>> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>>
> >>>
> >>
> >>---------------------------------------------------------------------
> >>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>
> >
> >
> >---------------------------------------------------------------------
> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
RE: file size limitation in slide 2.1 final
Posted by Sven Pfeiffer <sv...@innoface.de>.
I just continued trying and something strange happend.
when trying to upload a file with 4 GB,using webfolders, the content length is not correct.
but when using DAVExplorer the content-length is delivered correct (if read from req.getHeader("content-length")).
But still only the first 280 MB of the 4GB file are uploaded, but I think this is because there is somewhere another int in Slide?!
I am trying to find it.
Thanks for your help
SVen
>-----Original Message-----
>From: Sven Pfeiffer [mailto:sven.pfeiffer@innoface.de]
>Sent: Thursday, January 27, 2005 10:40 AM
>To: Slide Developers Mailing List; ozeigermann@apache.org
>Subject: RE: file size limitation in slide 2.1 final
>
>
>Hello Oliver
>
>how can I get the amount of data copied?
>
>I tried to read the content-length directly from request-objects header (Long.valueOf(req.getHeader("content-length")).longValue())
>and this seems to return the correct length, so I guess it is no limitation inside the web container, what do you think?
>
>thanks in advance
>SVen
>
>
>
>>-----Original Message-----
>>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>Sent: Wednesday, January 26, 2005 5:16 PM
>>To: Slide Developers Mailing List
>>Subject: Re: file size limitation in slide 2.1 final
>>
>>
>>That's bad news :(
>>
>>Sounds like a limitation inside the web container (Tomcat?) then.
>>Seems that request bodies longer than 2GB are not even passed properly
>>to the application. Could you verify this, e.g. by adding output for
>>the actual amount of data copied in the PutMethod lines 421 and 244?
>>
>>If so, maybe changing the web container or upgrading to a more recent
>>version of it could help.
>>
>>Oliver
>>
>>On Wed, 26 Jan 2005 16:05:06 +0100, Sven Pfeiffer
>><sv...@innoface.de> wrote:
>>> thank you again for your fast help.
>>>
>>> now i'm no longer getting exceptions on the server, but the file is still not uploaded.
>>> a file with the name is created, and 201 "Created" is printed on the server, but there is no content, the size is 0 kb.
>>>
>>> Files smaller then 2 GB are copied normal.
>>>
>>> >-----Original Message-----
>>> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>>
>>> >Sent: Wednesday, January 26, 2005 2:40 PM
>>> >To: Slide Developers Mailing List
>>> >Subject: Re: file size limitation in slide 2.1 final
>>> >
>>> >
>>> >Agreed. However, I have just committed a fix that should allow you to
>>> >store files of any size. The stream is streamed to a file first and
>>> >the amount of bytes copied now correctly is stored into a long instead
>>> >of an int.
>>> >
>>> >You will need to have
>>> >
>>> > <parameter name="repeat-upon-conflict">true</parameter>
>>> >
>>> >in your configuration section which is the case in the default Domain.xml.
>>> >
>>> >Please try it, maybe it helps.
>>> >
>>> >Oliver
>>> >
>>> >On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer
>>> ><sv...@innoface.de> wrote:
>>> >> if I am right, I am in trouble.
>>> >>
>>> >> I just tried to find out where the problem was and found that the size of the file is read from
>>> >> javax.servlet.http.HttpServletRequests getContentLength()-Method which returns an int.
>>> >>
>>> >> and if the file is larger then 2 GB the maximum capacity of int is exceeded and so it is -xyz.
>>> >>
>>> >> that would explain why it seemed to work with the 4GB-file because then we are back in the positiv range and so it
>>> >stores the file.
>>> >>
>>> >> What do you think?
>>> >> Am I right with this?
>>> >>
>>> >> Thanks in advance
>>> >>
>>> >> >-----Original Message-----
>>> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>> >>
>>> >> >Sent: Wednesday, January 26, 2005 9:04 AM
>>> >> >To: Slide Developers Mailing List
>>> >> >Subject: Re: file size limitation in slide 2.1 final
>>> >> >
>>> >> >
>>> >> >Does a file that is a bit smaller than 2 GB work? If so maybe there
>>> >> >are places inside the Slide code that use integers which can only
>>> >> >represent up to 2 GB...
>>> >> >
>>> >> >Oliver
>>> >> >
>>> >> >
>>> >> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
>>> >> ><sv...@innoface.de> wrote:
>>> >> >> Hello again,
>>> >> >>
>>> >> >> I just tried it again.
>>> >> >>
>>> >> >> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
>>> >> >>
>>> >> >> Again I tried to put a large file (>4 GB), I am getting
>>> >> >>
>>> >> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
>>> >> >>
>>> >> >> and the file is created, but it has just 287 MB.
>>> >> >>
>>> >> >> When trying to put a smaller file (780 MB) everything works fine.
>>> >> >>
>>> >> >> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS
>>> >> >is about 16
>>> >> >> EB or so.
>>> >> >>
>>> >> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the
>org.apache.slide.store.txfile.TxFileContentStore.
>>> >> >>
>>> >> >> And I put the file on it using WindowsXPs netfolders.
>>> >> >>
>>> >> >> Has anyone an idea why I can't upload larger files?
>>> >> >>
>>> >> >> thanks in advance
>>> >> >> SVen
>>> >> >>
>>> >> >> >-----Original Message-----
>>> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>> >> >>
>>> >> >> >Sent: Friday, January 07, 2005 3:21 PM
>>> >> >> >To: Sven Pfeiffer
>>> >> >> >Cc: Slide Developers Mailing List
>>> >> >> >Subject: Re: file size limitation in slide 2.1 final
>>> >> >> >
>>> >> >> >
>>> >> >> >OK, I just tried it with my installation (built from Slide head,
>>> >> >> >however) and I just copied a file more than 600MB long and it worked.
>>> >> >> >
>>> >> >> >What I have seen from the 2.1 sources is that when the client does not
>>> >> >> >pass the content length, the whole file is buffered in memory to find
>>> >> >> >it out. This is different in the Slide head.
>>> >> >> >
>>> >> >> >I did my test with Windows web folders which correctly passes the length anyway.
>>> >> >> >
>>> >> >> >Maybe this is somewhat related to your problem?
>>> >> >> >
>>> >> >> >Oliver
>>> >> >> >
>>> >> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
>>> >> >> ><sv...@innoface.de> wrote:
>>> >> >> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
>>> >> >> >the real size
>>> >> >> >> 561 MB which is also shown on the server.
>>> >> >> >>
>>> >> >> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than
>it stops.
>>> >> >> >the client
>>> >> >> >> seems to continue copying for about 5 minutes.
>>> >> >> >>
>>> >> >> >> the system returns 201 (created)
>>> >> >> >>
>>> >> >> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
>>> >> >> >>
>>> >> >> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
>>> >> >> >>
>>> >> >> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
>>> >> >> >>
>>> >> >> >> thank you for your support
>>> >> >> >>
>>> >> >> >> SVen
>>> >> >> >>
>>> >> >> >> >-----Original Message-----
>>> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>> >> >> >> >Sent: Friday, January 07, 2005 2:50 PM
>>> >> >> >> >To: Sven Pfeiffer
>>> >> >> >> >Cc: Slide Developers Mailing List
>>> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >What do the properties say? The original size? Does your file system
>>> >> >> >> >support larger files?
>>> >> >> >> >
>>> >> >> >> >Oliver
>>> >> >> >> >
>>> >> >> >> >
>>> >> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
>>> >> >> >> ><sv...@innoface.de> wrote:
>>> >> >> >> >> TxFileContentStore
>>> >> >> >> >>
>>> >> >> >> >>
>>> >> >> >> >> >-----Original Message-----
>>> >> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>> >> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM
>>> >> >> >> >> >To: Slide Developers Mailing List
>>> >> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >Which store?
>>> >> >> >> >> >
>>> >> >> >> >> >Oliver
>>> >> >> >> >> >
>>> >> >> >> >> >
>>> >> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
>>> >> >> >> >> ><sv...@innoface.de> wrote:
>>> >> >> >> >> >> Hi List
>>> >> >> >> >> >>
>>> >> >> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
>>> >> >> >> >> >>
>>> >> >> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
>>> >> >> >> >they are simply
>>> >> >> >> >> >> cut.
>>> >> >> >> >> >>
>>> >> >> >> >> >> Is there a way to avoid this?
>>> >> >> >> >> >>
>>> >> >> >> >> >> thanks in advance
>>> >> >> >> >> >>
>>> >> >> >> >> >> SVen
>>> >> >> >> >> >>
>>> >> >> >> >> >> ---------------------------------------------------------------------
>>> >> >> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>>> >> >> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>> >> >> >> >> >>
>>> >> >> >> >> >>
>>> >> >> >> >> >
>>> >> >> >> >> >---------------------------------------------------------------------
>>> >> >> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>>> >> >> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>> >> >> >> >> >
>>> >> >> >> >>
>>> >> >> >> >>
>>> >> >> >>
>>> >> >> >>
>>> >> >> >
>>> >> >> >---------------------------------------------------------------------
>>> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>>> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>> >> >> >
>>> >> >>
>>> >> >> ---------------------------------------------------------------------
>>> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>>> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>> >> >>
>>> >> >>
>>> >> >
>>> >> >---------------------------------------------------------------------
>>> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>>> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>> >> >
>>> >>
>>> >> ---------------------------------------------------------------------
>>> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>>> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>> >>
>>> >>
>>> >
>>> >---------------------------------------------------------------------
>>> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>>> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>> >
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>>> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>>
>>>
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
RE: file size limitation in slide 2.1 final
Posted by Sven Pfeiffer <sv...@innoface.de>.
Hello Oliver
how can I get the amount of data copied?
I tried to read the content-length directly from request-objects header (Long.valueOf(req.getHeader("content-length")).longValue())
and this seems to return the correct length, so I guess it is no limitation inside the web container, what do you think?
thanks in advance
SVen
>-----Original Message-----
>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>Sent: Wednesday, January 26, 2005 5:16 PM
>To: Slide Developers Mailing List
>Subject: Re: file size limitation in slide 2.1 final
>
>
>That's bad news :(
>
>Sounds like a limitation inside the web container (Tomcat?) then.
>Seems that request bodies longer than 2GB are not even passed properly
>to the application. Could you verify this, e.g. by adding output for
>the actual amount of data copied in the PutMethod lines 421 and 244?
>
>If so, maybe changing the web container or upgrading to a more recent
>version of it could help.
>
>Oliver
>
>On Wed, 26 Jan 2005 16:05:06 +0100, Sven Pfeiffer
><sv...@innoface.de> wrote:
>> thank you again for your fast help.
>>
>> now i'm no longer getting exceptions on the server, but the file is still not uploaded.
>> a file with the name is created, and 201 "Created" is printed on the server, but there is no content, the size is 0 kb.
>>
>> Files smaller then 2 GB are copied normal.
>>
>> >-----Original Message-----
>> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>
>> >Sent: Wednesday, January 26, 2005 2:40 PM
>> >To: Slide Developers Mailing List
>> >Subject: Re: file size limitation in slide 2.1 final
>> >
>> >
>> >Agreed. However, I have just committed a fix that should allow you to
>> >store files of any size. The stream is streamed to a file first and
>> >the amount of bytes copied now correctly is stored into a long instead
>> >of an int.
>> >
>> >You will need to have
>> >
>> > <parameter name="repeat-upon-conflict">true</parameter>
>> >
>> >in your configuration section which is the case in the default Domain.xml.
>> >
>> >Please try it, maybe it helps.
>> >
>> >Oliver
>> >
>> >On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer
>> ><sv...@innoface.de> wrote:
>> >> if I am right, I am in trouble.
>> >>
>> >> I just tried to find out where the problem was and found that the size of the file is read from
>> >> javax.servlet.http.HttpServletRequests getContentLength()-Method which returns an int.
>> >>
>> >> and if the file is larger then 2 GB the maximum capacity of int is exceeded and so it is -xyz.
>> >>
>> >> that would explain why it seemed to work with the 4GB-file because then we are back in the positiv range and so it
>> >stores the file.
>> >>
>> >> What do you think?
>> >> Am I right with this?
>> >>
>> >> Thanks in advance
>> >>
>> >> >-----Original Message-----
>> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >>
>> >> >Sent: Wednesday, January 26, 2005 9:04 AM
>> >> >To: Slide Developers Mailing List
>> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >
>> >> >
>> >> >Does a file that is a bit smaller than 2 GB work? If so maybe there
>> >> >are places inside the Slide code that use integers which can only
>> >> >represent up to 2 GB...
>> >> >
>> >> >Oliver
>> >> >
>> >> >
>> >> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
>> >> ><sv...@innoface.de> wrote:
>> >> >> Hello again,
>> >> >>
>> >> >> I just tried it again.
>> >> >>
>> >> >> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
>> >> >>
>> >> >> Again I tried to put a large file (>4 GB), I am getting
>> >> >>
>> >> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
>> >> >>
>> >> >> and the file is created, but it has just 287 MB.
>> >> >>
>> >> >> When trying to put a smaller file (780 MB) everything works fine.
>> >> >>
>> >> >> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS
>> >> >is about 16
>> >> >> EB or so.
>> >> >>
>> >> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the org.apache.slide.store.txfile.TxFileContentStore.
>> >> >>
>> >> >> And I put the file on it using WindowsXPs netfolders.
>> >> >>
>> >> >> Has anyone an idea why I can't upload larger files?
>> >> >>
>> >> >> thanks in advance
>> >> >> SVen
>> >> >>
>> >> >> >-----Original Message-----
>> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >>
>> >> >> >Sent: Friday, January 07, 2005 3:21 PM
>> >> >> >To: Sven Pfeiffer
>> >> >> >Cc: Slide Developers Mailing List
>> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >> >
>> >> >> >
>> >> >> >OK, I just tried it with my installation (built from Slide head,
>> >> >> >however) and I just copied a file more than 600MB long and it worked.
>> >> >> >
>> >> >> >What I have seen from the 2.1 sources is that when the client does not
>> >> >> >pass the content length, the whole file is buffered in memory to find
>> >> >> >it out. This is different in the Slide head.
>> >> >> >
>> >> >> >I did my test with Windows web folders which correctly passes the length anyway.
>> >> >> >
>> >> >> >Maybe this is somewhat related to your problem?
>> >> >> >
>> >> >> >Oliver
>> >> >> >
>> >> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
>> >> >> ><sv...@innoface.de> wrote:
>> >> >> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
>> >> >> >the real size
>> >> >> >> 561 MB which is also shown on the server.
>> >> >> >>
>> >> >> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than it stops.
>> >> >> >the client
>> >> >> >> seems to continue copying for about 5 minutes.
>> >> >> >>
>> >> >> >> the system returns 201 (created)
>> >> >> >>
>> >> >> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
>> >> >> >>
>> >> >> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
>> >> >> >>
>> >> >> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
>> >> >> >>
>> >> >> >> thank you for your support
>> >> >> >>
>> >> >> >> SVen
>> >> >> >>
>> >> >> >> >-----Original Message-----
>> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >> >> >Sent: Friday, January 07, 2005 2:50 PM
>> >> >> >> >To: Sven Pfeiffer
>> >> >> >> >Cc: Slide Developers Mailing List
>> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >What do the properties say? The original size? Does your file system
>> >> >> >> >support larger files?
>> >> >> >> >
>> >> >> >> >Oliver
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
>> >> >> >> ><sv...@innoface.de> wrote:
>> >> >> >> >> TxFileContentStore
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >> >-----Original Message-----
>> >> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM
>> >> >> >> >> >To: Slide Developers Mailing List
>> >> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >> >> >> >
>> >> >> >> >> >
>> >> >> >> >> >Which store?
>> >> >> >> >> >
>> >> >> >> >> >Oliver
>> >> >> >> >> >
>> >> >> >> >> >
>> >> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
>> >> >> >> >> ><sv...@innoface.de> wrote:
>> >> >> >> >> >> Hi List
>> >> >> >> >> >>
>> >> >> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
>> >> >> >> >> >>
>> >> >> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
>> >> >> >> >they are simply
>> >> >> >> >> >> cut.
>> >> >> >> >> >>
>> >> >> >> >> >> Is there a way to avoid this?
>> >> >> >> >> >>
>> >> >> >> >> >> thanks in advance
>> >> >> >> >> >>
>> >> >> >> >> >> SVen
>> >> >> >> >> >>
>> >> >> >> >> >> ---------------------------------------------------------------------
>> >> >> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >> >> >> >>
>> >> >> >> >> >>
>> >> >> >> >> >
>> >> >> >> >> >---------------------------------------------------------------------
>> >> >> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >> >> >> >
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >
>> >> >> >---------------------------------------------------------------------
>> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >> >
>> >> >>
>> >> >> ---------------------------------------------------------------------
>> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >>
>> >> >>
>> >> >
>> >> >---------------------------------------------------------------------
>> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>
>> >>
>> >
>> >---------------------------------------------------------------------
>> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>
>>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: file size limitation in slide 2.1 final
Posted by Oliver Zeigermann <ol...@gmail.com>.
That's bad news :(
Sounds like a limitation inside the web container (Tomcat?) then.
Seems that request bodies longer than 2GB are not even passed properly
to the application. Could you verify this, e.g. by adding output for
the actual amount of data copied in the PutMethod lines 421 and 244?
If so, maybe changing the web container or upgrading to a more recent
version of it could help.
Oliver
On Wed, 26 Jan 2005 16:05:06 +0100, Sven Pfeiffer
<sv...@innoface.de> wrote:
> thank you again for your fast help.
>
> now i'm no longer getting exceptions on the server, but the file is still not uploaded.
> a file with the name is created, and 201 "Created" is printed on the server, but there is no content, the size is 0 kb.
>
> Files smaller then 2 GB are copied normal.
>
> >-----Original Message-----
> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>
> >Sent: Wednesday, January 26, 2005 2:40 PM
> >To: Slide Developers Mailing List
> >Subject: Re: file size limitation in slide 2.1 final
> >
> >
> >Agreed. However, I have just committed a fix that should allow you to
> >store files of any size. The stream is streamed to a file first and
> >the amount of bytes copied now correctly is stored into a long instead
> >of an int.
> >
> >You will need to have
> >
> > <parameter name="repeat-upon-conflict">true</parameter>
> >
> >in your configuration section which is the case in the default Domain.xml.
> >
> >Please try it, maybe it helps.
> >
> >Oliver
> >
> >On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer
> ><sv...@innoface.de> wrote:
> >> if I am right, I am in trouble.
> >>
> >> I just tried to find out where the problem was and found that the size of the file is read from
> >> javax.servlet.http.HttpServletRequests getContentLength()-Method which returns an int.
> >>
> >> and if the file is larger then 2 GB the maximum capacity of int is exceeded and so it is -xyz.
> >>
> >> that would explain why it seemed to work with the 4GB-file because then we are back in the positiv range and so it
> >stores the file.
> >>
> >> What do you think?
> >> Am I right with this?
> >>
> >> Thanks in advance
> >>
> >> >-----Original Message-----
> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >>
> >> >Sent: Wednesday, January 26, 2005 9:04 AM
> >> >To: Slide Developers Mailing List
> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >
> >> >
> >> >Does a file that is a bit smaller than 2 GB work? If so maybe there
> >> >are places inside the Slide code that use integers which can only
> >> >represent up to 2 GB...
> >> >
> >> >Oliver
> >> >
> >> >
> >> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
> >> ><sv...@innoface.de> wrote:
> >> >> Hello again,
> >> >>
> >> >> I just tried it again.
> >> >>
> >> >> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
> >> >>
> >> >> Again I tried to put a large file (>4 GB), I am getting
> >> >>
> >> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
> >> >>
> >> >> and the file is created, but it has just 287 MB.
> >> >>
> >> >> When trying to put a smaller file (780 MB) everything works fine.
> >> >>
> >> >> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS
> >> >is about 16
> >> >> EB or so.
> >> >>
> >> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the org.apache.slide.store.txfile.TxFileContentStore.
> >> >>
> >> >> And I put the file on it using WindowsXPs netfolders.
> >> >>
> >> >> Has anyone an idea why I can't upload larger files?
> >> >>
> >> >> thanks in advance
> >> >> SVen
> >> >>
> >> >> >-----Original Message-----
> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >> >>
> >> >> >Sent: Friday, January 07, 2005 3:21 PM
> >> >> >To: Sven Pfeiffer
> >> >> >Cc: Slide Developers Mailing List
> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >> >
> >> >> >
> >> >> >OK, I just tried it with my installation (built from Slide head,
> >> >> >however) and I just copied a file more than 600MB long and it worked.
> >> >> >
> >> >> >What I have seen from the 2.1 sources is that when the client does not
> >> >> >pass the content length, the whole file is buffered in memory to find
> >> >> >it out. This is different in the Slide head.
> >> >> >
> >> >> >I did my test with Windows web folders which correctly passes the length anyway.
> >> >> >
> >> >> >Maybe this is somewhat related to your problem?
> >> >> >
> >> >> >Oliver
> >> >> >
> >> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
> >> >> ><sv...@innoface.de> wrote:
> >> >> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
> >> >> >the real size
> >> >> >> 561 MB which is also shown on the server.
> >> >> >>
> >> >> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than it stops.
> >> >> >the client
> >> >> >> seems to continue copying for about 5 minutes.
> >> >> >>
> >> >> >> the system returns 201 (created)
> >> >> >>
> >> >> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
> >> >> >>
> >> >> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
> >> >> >>
> >> >> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
> >> >> >>
> >> >> >> thank you for your support
> >> >> >>
> >> >> >> SVen
> >> >> >>
> >> >> >> >-----Original Message-----
> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >> >> >> >Sent: Friday, January 07, 2005 2:50 PM
> >> >> >> >To: Sven Pfeiffer
> >> >> >> >Cc: Slide Developers Mailing List
> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >> >> >
> >> >> >> >
> >> >> >> >What do the properties say? The original size? Does your file system
> >> >> >> >support larger files?
> >> >> >> >
> >> >> >> >Oliver
> >> >> >> >
> >> >> >> >
> >> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
> >> >> >> ><sv...@innoface.de> wrote:
> >> >> >> >> TxFileContentStore
> >> >> >> >>
> >> >> >> >>
> >> >> >> >> >-----Original Message-----
> >> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM
> >> >> >> >> >To: Slide Developers Mailing List
> >> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >> >> >> >
> >> >> >> >> >
> >> >> >> >> >Which store?
> >> >> >> >> >
> >> >> >> >> >Oliver
> >> >> >> >> >
> >> >> >> >> >
> >> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
> >> >> >> >> ><sv...@innoface.de> wrote:
> >> >> >> >> >> Hi List
> >> >> >> >> >>
> >> >> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
> >> >> >> >> >>
> >> >> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
> >> >> >> >they are simply
> >> >> >> >> >> cut.
> >> >> >> >> >>
> >> >> >> >> >> Is there a way to avoid this?
> >> >> >> >> >>
> >> >> >> >> >> thanks in advance
> >> >> >> >> >>
> >> >> >> >> >> SVen
> >> >> >> >> >>
> >> >> >> >> >> ---------------------------------------------------------------------
> >> >> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >> >> >> >>
> >> >> >> >> >>
> >> >> >> >> >
> >> >> >> >> >---------------------------------------------------------------------
> >> >> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >> >> >> >
> >> >> >> >>
> >> >> >> >>
> >> >> >>
> >> >> >>
> >> >> >
> >> >> >---------------------------------------------------------------------
> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >> >
> >> >>
> >> >> ---------------------------------------------------------------------
> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >>
> >> >>
> >> >
> >> >---------------------------------------------------------------------
> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>
> >>
> >
> >---------------------------------------------------------------------
> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
RE: file size limitation in slide 2.1 final
Posted by Sven Pfeiffer <sv...@innoface.de>.
thank you again for your fast help.
now i'm no longer getting exceptions on the server, but the file is still not uploaded.
a file with the name is created, and 201 "Created" is printed on the server, but there is no content, the size is 0 kb.
Files smaller then 2 GB are copied normal.
>-----Original Message-----
>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>Sent: Wednesday, January 26, 2005 2:40 PM
>To: Slide Developers Mailing List
>Subject: Re: file size limitation in slide 2.1 final
>
>
>Agreed. However, I have just committed a fix that should allow you to
>store files of any size. The stream is streamed to a file first and
>the amount of bytes copied now correctly is stored into a long instead
>of an int.
>
>You will need to have
>
> <parameter name="repeat-upon-conflict">true</parameter>
>
>in your configuration section which is the case in the default Domain.xml.
>
>Please try it, maybe it helps.
>
>Oliver
>
>On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer
><sv...@innoface.de> wrote:
>> if I am right, I am in trouble.
>>
>> I just tried to find out where the problem was and found that the size of the file is read from
>> javax.servlet.http.HttpServletRequests getContentLength()-Method which returns an int.
>>
>> and if the file is larger then 2 GB the maximum capacity of int is exceeded and so it is -xyz.
>>
>> that would explain why it seemed to work with the 4GB-file because then we are back in the positiv range and so it
>stores the file.
>>
>> What do you think?
>> Am I right with this?
>>
>> Thanks in advance
>>
>> >-----Original Message-----
>> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>
>> >Sent: Wednesday, January 26, 2005 9:04 AM
>> >To: Slide Developers Mailing List
>> >Subject: Re: file size limitation in slide 2.1 final
>> >
>> >
>> >Does a file that is a bit smaller than 2 GB work? If so maybe there
>> >are places inside the Slide code that use integers which can only
>> >represent up to 2 GB...
>> >
>> >Oliver
>> >
>> >
>> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
>> ><sv...@innoface.de> wrote:
>> >> Hello again,
>> >>
>> >> I just tried it again.
>> >>
>> >> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
>> >>
>> >> Again I tried to put a large file (>4 GB), I am getting
>> >>
>> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
>> >>
>> >> and the file is created, but it has just 287 MB.
>> >>
>> >> When trying to put a smaller file (780 MB) everything works fine.
>> >>
>> >> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS
>> >is about 16
>> >> EB or so.
>> >>
>> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the org.apache.slide.store.txfile.TxFileContentStore.
>> >>
>> >> And I put the file on it using WindowsXPs netfolders.
>> >>
>> >> Has anyone an idea why I can't upload larger files?
>> >>
>> >> thanks in advance
>> >> SVen
>> >>
>> >> >-----Original Message-----
>> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >>
>> >> >Sent: Friday, January 07, 2005 3:21 PM
>> >> >To: Sven Pfeiffer
>> >> >Cc: Slide Developers Mailing List
>> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >
>> >> >
>> >> >OK, I just tried it with my installation (built from Slide head,
>> >> >however) and I just copied a file more than 600MB long and it worked.
>> >> >
>> >> >What I have seen from the 2.1 sources is that when the client does not
>> >> >pass the content length, the whole file is buffered in memory to find
>> >> >it out. This is different in the Slide head.
>> >> >
>> >> >I did my test with Windows web folders which correctly passes the length anyway.
>> >> >
>> >> >Maybe this is somewhat related to your problem?
>> >> >
>> >> >Oliver
>> >> >
>> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
>> >> ><sv...@innoface.de> wrote:
>> >> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
>> >> >the real size
>> >> >> 561 MB which is also shown on the server.
>> >> >>
>> >> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than it stops.
>> >> >the client
>> >> >> seems to continue copying for about 5 minutes.
>> >> >>
>> >> >> the system returns 201 (created)
>> >> >>
>> >> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
>> >> >>
>> >> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
>> >> >>
>> >> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
>> >> >>
>> >> >> thank you for your support
>> >> >>
>> >> >> SVen
>> >> >>
>> >> >> >-----Original Message-----
>> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >> >Sent: Friday, January 07, 2005 2:50 PM
>> >> >> >To: Sven Pfeiffer
>> >> >> >Cc: Slide Developers Mailing List
>> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >> >
>> >> >> >
>> >> >> >What do the properties say? The original size? Does your file system
>> >> >> >support larger files?
>> >> >> >
>> >> >> >Oliver
>> >> >> >
>> >> >> >
>> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
>> >> >> ><sv...@innoface.de> wrote:
>> >> >> >> TxFileContentStore
>> >> >> >>
>> >> >> >>
>> >> >> >> >-----Original Message-----
>> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM
>> >> >> >> >To: Slide Developers Mailing List
>> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >Which store?
>> >> >> >> >
>> >> >> >> >Oliver
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
>> >> >> >> ><sv...@innoface.de> wrote:
>> >> >> >> >> Hi List
>> >> >> >> >>
>> >> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
>> >> >> >> >>
>> >> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
>> >> >> >they are simply
>> >> >> >> >> cut.
>> >> >> >> >>
>> >> >> >> >> Is there a way to avoid this?
>> >> >> >> >>
>> >> >> >> >> thanks in advance
>> >> >> >> >>
>> >> >> >> >> SVen
>> >> >> >> >>
>> >> >> >> >> ---------------------------------------------------------------------
>> >> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >
>> >> >> >> >---------------------------------------------------------------------
>> >> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >> >> >
>> >> >> >>
>> >> >> >>
>> >> >>
>> >> >>
>> >> >
>> >> >---------------------------------------------------------------------
>> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >>
>> >>
>> >
>> >---------------------------------------------------------------------
>> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>
>>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: file size limitation in slide 2.1 final
Posted by Oliver Zeigermann <ol...@gmail.com>.
Agreed. However, I have just committed a fix that should allow you to
store files of any size. The stream is streamed to a file first and
the amount of bytes copied now correctly is stored into a long instead
of an int.
You will need to have
<parameter name="repeat-upon-conflict">true</parameter>
in your configuration section which is the case in the default Domain.xml.
Please try it, maybe it helps.
Oliver
On Wed, 26 Jan 2005 13:07:47 +0100, Sven Pfeiffer
<sv...@innoface.de> wrote:
> if I am right, I am in trouble.
>
> I just tried to find out where the problem was and found that the size of the file is read from
> javax.servlet.http.HttpServletRequests getContentLength()-Method which returns an int.
>
> and if the file is larger then 2 GB the maximum capacity of int is exceeded and so it is -xyz.
>
> that would explain why it seemed to work with the 4GB-file because then we are back in the positiv range and so it stores the file.
>
> What do you think?
> Am I right with this?
>
> Thanks in advance
>
> >-----Original Message-----
> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>
> >Sent: Wednesday, January 26, 2005 9:04 AM
> >To: Slide Developers Mailing List
> >Subject: Re: file size limitation in slide 2.1 final
> >
> >
> >Does a file that is a bit smaller than 2 GB work? If so maybe there
> >are places inside the Slide code that use integers which can only
> >represent up to 2 GB...
> >
> >Oliver
> >
> >
> >On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
> ><sv...@innoface.de> wrote:
> >> Hello again,
> >>
> >> I just tried it again.
> >>
> >> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
> >>
> >> Again I tried to put a large file (>4 GB), I am getting
> >>
> >> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
> >>
> >> and the file is created, but it has just 287 MB.
> >>
> >> When trying to put a smaller file (780 MB) everything works fine.
> >>
> >> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS
> >is about 16
> >> EB or so.
> >>
> >> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the org.apache.slide.store.txfile.TxFileContentStore.
> >>
> >> And I put the file on it using WindowsXPs netfolders.
> >>
> >> Has anyone an idea why I can't upload larger files?
> >>
> >> thanks in advance
> >> SVen
> >>
> >> >-----Original Message-----
> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >>
> >> >Sent: Friday, January 07, 2005 3:21 PM
> >> >To: Sven Pfeiffer
> >> >Cc: Slide Developers Mailing List
> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >
> >> >
> >> >OK, I just tried it with my installation (built from Slide head,
> >> >however) and I just copied a file more than 600MB long and it worked.
> >> >
> >> >What I have seen from the 2.1 sources is that when the client does not
> >> >pass the content length, the whole file is buffered in memory to find
> >> >it out. This is different in the Slide head.
> >> >
> >> >I did my test with Windows web folders which correctly passes the length anyway.
> >> >
> >> >Maybe this is somewhat related to your problem?
> >> >
> >> >Oliver
> >> >
> >> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
> >> ><sv...@innoface.de> wrote:
> >> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
> >> >the real size
> >> >> 561 MB which is also shown on the server.
> >> >>
> >> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than it stops.
> >> >the client
> >> >> seems to continue copying for about 5 minutes.
> >> >>
> >> >> the system returns 201 (created)
> >> >>
> >> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
> >> >>
> >> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
> >> >>
> >> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
> >> >>
> >> >> thank you for your support
> >> >>
> >> >> SVen
> >> >>
> >> >> >-----Original Message-----
> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >> >> >Sent: Friday, January 07, 2005 2:50 PM
> >> >> >To: Sven Pfeiffer
> >> >> >Cc: Slide Developers Mailing List
> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >> >
> >> >> >
> >> >> >What do the properties say? The original size? Does your file system
> >> >> >support larger files?
> >> >> >
> >> >> >Oliver
> >> >> >
> >> >> >
> >> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
> >> >> ><sv...@innoface.de> wrote:
> >> >> >> TxFileContentStore
> >> >> >>
> >> >> >>
> >> >> >> >-----Original Message-----
> >> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >> >> >> >Sent: Friday, January 07, 2005 2:37 PM
> >> >> >> >To: Slide Developers Mailing List
> >> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >> >> >
> >> >> >> >
> >> >> >> >Which store?
> >> >> >> >
> >> >> >> >Oliver
> >> >> >> >
> >> >> >> >
> >> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
> >> >> >> ><sv...@innoface.de> wrote:
> >> >> >> >> Hi List
> >> >> >> >>
> >> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
> >> >> >> >>
> >> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
> >> >> >they are simply
> >> >> >> >> cut.
> >> >> >> >>
> >> >> >> >> Is there a way to avoid this?
> >> >> >> >>
> >> >> >> >> thanks in advance
> >> >> >> >>
> >> >> >> >> SVen
> >> >> >> >>
> >> >> >> >> ---------------------------------------------------------------------
> >> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >> >> >>
> >> >> >> >>
> >> >> >> >
> >> >> >> >---------------------------------------------------------------------
> >> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >> >> >
> >> >> >>
> >> >> >>
> >> >>
> >> >>
> >> >
> >> >---------------------------------------------------------------------
> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>
> >>
> >
> >---------------------------------------------------------------------
> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
RE: file size limitation in slide 2.1 final
Posted by Sven Pfeiffer <sv...@innoface.de>.
if I am right, I am in trouble.
I just tried to find out where the problem was and found that the size of the file is read from
javax.servlet.http.HttpServletRequests getContentLength()-Method which returns an int.
and if the file is larger then 2 GB the maximum capacity of int is exceeded and so it is -xyz.
that would explain why it seemed to work with the 4GB-file because then we are back in the positiv range and so it stores the file.
What do you think?
Am I right with this?
Thanks in advance
>-----Original Message-----
>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>Sent: Wednesday, January 26, 2005 9:04 AM
>To: Slide Developers Mailing List
>Subject: Re: file size limitation in slide 2.1 final
>
>
>Does a file that is a bit smaller than 2 GB work? If so maybe there
>are places inside the Slide code that use integers which can only
>represent up to 2 GB...
>
>Oliver
>
>
>On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
><sv...@innoface.de> wrote:
>> Hello again,
>>
>> I just tried it again.
>>
>> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
>>
>> Again I tried to put a large file (>4 GB), I am getting
>>
>> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
>>
>> and the file is created, but it has just 287 MB.
>>
>> When trying to put a smaller file (780 MB) everything works fine.
>>
>> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS
>is about 16
>> EB or so.
>>
>> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the org.apache.slide.store.txfile.TxFileContentStore.
>>
>> And I put the file on it using WindowsXPs netfolders.
>>
>> Has anyone an idea why I can't upload larger files?
>>
>> thanks in advance
>> SVen
>>
>> >-----Original Message-----
>> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>
>> >Sent: Friday, January 07, 2005 3:21 PM
>> >To: Sven Pfeiffer
>> >Cc: Slide Developers Mailing List
>> >Subject: Re: file size limitation in slide 2.1 final
>> >
>> >
>> >OK, I just tried it with my installation (built from Slide head,
>> >however) and I just copied a file more than 600MB long and it worked.
>> >
>> >What I have seen from the 2.1 sources is that when the client does not
>> >pass the content length, the whole file is buffered in memory to find
>> >it out. This is different in the Slide head.
>> >
>> >I did my test with Windows web folders which correctly passes the length anyway.
>> >
>> >Maybe this is somewhat related to your problem?
>> >
>> >Oliver
>> >
>> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
>> ><sv...@innoface.de> wrote:
>> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
>> >the real size
>> >> 561 MB which is also shown on the server.
>> >>
>> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than it stops.
>> >the client
>> >> seems to continue copying for about 5 minutes.
>> >>
>> >> the system returns 201 (created)
>> >>
>> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
>> >>
>> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
>> >>
>> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
>> >>
>> >> thank you for your support
>> >>
>> >> SVen
>> >>
>> >> >-----Original Message-----
>> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >Sent: Friday, January 07, 2005 2:50 PM
>> >> >To: Sven Pfeiffer
>> >> >Cc: Slide Developers Mailing List
>> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >
>> >> >
>> >> >What do the properties say? The original size? Does your file system
>> >> >support larger files?
>> >> >
>> >> >Oliver
>> >> >
>> >> >
>> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
>> >> ><sv...@innoface.de> wrote:
>> >> >> TxFileContentStore
>> >> >>
>> >> >>
>> >> >> >-----Original Message-----
>> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >> >Sent: Friday, January 07, 2005 2:37 PM
>> >> >> >To: Slide Developers Mailing List
>> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >> >
>> >> >> >
>> >> >> >Which store?
>> >> >> >
>> >> >> >Oliver
>> >> >> >
>> >> >> >
>> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
>> >> >> ><sv...@innoface.de> wrote:
>> >> >> >> Hi List
>> >> >> >>
>> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
>> >> >> >>
>> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
>> >> >they are simply
>> >> >> >> cut.
>> >> >> >>
>> >> >> >> Is there a way to avoid this?
>> >> >> >>
>> >> >> >> thanks in advance
>> >> >> >>
>> >> >> >> SVen
>> >> >> >>
>> >> >> >> ---------------------------------------------------------------------
>> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >> >>
>> >> >> >>
>> >> >> >
>> >> >> >---------------------------------------------------------------------
>> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >> >
>> >> >>
>> >> >>
>> >>
>> >>
>> >
>> >---------------------------------------------------------------------
>> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>
>>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
RE: file size limitation in slide 2.1 final
Posted by Sven Pfeiffer <sv...@innoface.de>.
it looks like that was a good hint
i tried a file with exactly 2 GB, and it worked.
then i tried with a file with 3 MB more and I got an error.
thank you oliver
here is the an excerpt of the log file (i'm just trying to understand it):
DEBUG [net.sf.ehcache.store.MemoryStore] org.apache.slide.webdav.util.UriHandlerCache: MemoryStore hit for /files/public/bla.blubb
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb now: 1106733590640
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Creation Time: 1106733590640 Next To Last Access Time: 0
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb mostRecentTime: 1106733590640
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Age to Idle: 0 Age Idled: 0
DEBUG [net.sf.ehcache.Cache] org.apache.slide.webdav.util.UriHandler: Is element with key /files/public/bla.blubb expired?: false
INFO [STDOUT] TP-Processor4, 26-Jan-2005 10:59:50, sep, HEAD, 404 "Not Found", 31 ms, /files/public/bla.blubb
TRACE [org.jboss.security.plugins.JaasSecurityManager.if-login] validateCache,
info=org.jboss.security.plugins.JaasSecurityManager$DomainInfo@62be97
DEBUG [net.sf.ehcache.store.MemoryStore] org.apache.slide.webdav.util.UriHandlerCache: MemoryStore hit for /files/public/bla.blubb
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb now: 1106733590687
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Creation Time: 1106733590640 Next To Last Access Time: 1106733590640
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb mostRecentTime: 1106733590640
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Age to Idle: 0 Age Idled: 47
DEBUG [net.sf.ehcache.Cache] org.apache.slide.webdav.util.UriHandler: Is element with key /files/public/bla.blubb expired?: false
DEBUG [net.sf.ehcache.store.MemoryStore] org.apache.slide.webdav.util.UriHandlerCache: MemoryStore hit for /files/public/bla.blubb
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb now: 1106733590687
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Creation Time: 1106733590640 Next To Last Access Time: 1106733590687
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb mostRecentTime: 1106733590687
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Age to Idle: 0 Age Idled: 0
DEBUG [net.sf.ehcache.Cache] org.apache.slide.webdav.util.UriHandler: Is element with key /files/public/bla.blubb expired?: false
DEBUG [net.sf.ehcache.store.MemoryStore] org.apache.slide.webdav.util.UriHandlerCache: MemoryStore hit for /files/public/bla.blubb
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb now: 1106733590687
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Creation Time: 1106733590640 Next To Last Access Time: 1106733590687
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb mostRecentTime: 1106733590687
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Age to Idle: 0 Age Idled: 0
DEBUG [net.sf.ehcache.Cache] org.apache.slide.webdav.util.UriHandler: Is element with key /files/public/bla.blubb expired?: false
DEBUG [net.sf.ehcache.store.MemoryStore] org.apache.slide.webdav.util.UriHandlerCache: MemoryStore hit for /files/public/bla.blubb
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb now: 1106733590718
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Creation Time: 1106733590640 Next To Last Access Time: 1106733590687
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb mostRecentTime: 1106733590687
DEBUG [net.sf.ehcache.Cache] /files/public/bla.blubb Age to Idle: 0 Age Idled: 31
DEBUG [net.sf.ehcache.Cache] org.apache.slide.webdav.util.UriHandler: Is element with key /files/public/bla.blubb expired?: false
DEBUG [net.sf.ehcache.store.MemoryStore] org.apache.slide.webdav.util.UriHandlerCache: MemoryStore hit for /files/public
DEBUG [net.sf.ehcache.Cache] /files/public now: 1106733590718
DEBUG [net.sf.ehcache.Cache] /files/public Creation Time: 1106733528000 Next To Last Access Time: 1106733583796
DEBUG [net.sf.ehcache.Cache] /files/public mostRecentTime: 1106733583796
DEBUG [net.sf.ehcache.Cache] /files/public Age to Idle: 0 Age Idled: 6922
DEBUG [net.sf.ehcache.Cache] org.apache.slide.webdav.util.UriHandler: Is element with key /files/public expired?: false
DEBUG [net.sf.ehcache.store.MemoryStore] org.apache.slide.webdav.util.UriHandlerCache: MemoryStore hit for /files/public
DEBUG [net.sf.ehcache.Cache] /files/public now: 1106733590718
DEBUG [net.sf.ehcache.Cache] /files/public Creation Time: 1106733528000 Next To Last Access Time: 1106733590718
DEBUG [net.sf.ehcache.Cache] /files/public mostRecentTime: 1106733590718
DEBUG [net.sf.ehcache.Cache] /files/public Age to Idle: 0 Age Idled: 0
DEBUG [net.sf.ehcache.Cache] org.apache.slide.webdav.util.UriHandler: Is element with key /files/public expired?: false
INFO [STDOUT] 26 Jan 2005 10:59:51 - file-content-store - WARNING - Could not process URI '/files/public/bla.blubb'! Thread
Thread[TP-Processor3,5,jboss] marking transaction branch TP-Processor3-1106733590687-5 for rollback
ERROR [STDERR] org.apache.commons.transaction.file.ResourceManagerSystemException: TP-Processor3-1106733590687-5: Failed to undo
change / create of '/files/public/bla.blubb_1.0' (ERR_SYSTEM)
ERROR [STDERR] at
org.apache.commons.transaction.file.FileResourceManager.undoScheduledChangeOrCreate(FileResourceManager.java:1015)
ERROR [STDERR] at org.apache.commons.transaction.file.FileResourceManager.deleteResource(FileResourceManager.java:724)
ERROR [STDERR] at org.apache.commons.transaction.file.FileResourceManager.deleteResource(FileResourceManager.java:704)
ERROR [STDERR] at org.apache.slide.store.txfile.TxFileContentStore.storeRevisionContent(TxFileContentStore.java:116)
ERROR [STDERR] at org.apache.slide.store.txfile.TxFileContentStore.createRevisionContent(TxFileContentStore.java:84)
ERROR [STDERR] at org.apache.slide.store.AbstractStore.createRevisionContent(AbstractStore.java:1515)
ERROR [STDERR] at org.apache.slide.store.ExtendedStore.createRevisionContent(ExtendedStore.java:516)
ERROR [STDERR] at org.apache.slide.content.ContentImpl.create(ContentImpl.java:548)
ERROR [STDERR] at org.apache.slide.webdav.method.PutMethod.executeRequest(PutMethod.java:427)
ERROR [STDERR] at org.apache.slide.webdav.method.AbstractWebdavMethod.executeRedirect(AbstractWebdavMethod.java:584)
ERROR [STDERR] at org.apache.slide.webdav.method.AbstractWebdavMethod.run(AbstractWebdavMethod.java:425)
ERROR [STDERR] at org.apache.slide.webdav.WebdavServlet.service(WebdavServlet.java:151)
ERROR [STDERR] at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:247)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193)
ERROR [STDERR] at org.apache.slide.webdav.filter.LogFilter.doFilter(LogFilter.java:141)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:213)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193)
ERROR [STDERR] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:256)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.jboss.web.tomcat.security.JBossSecurityMgrRealm.invoke(JBossSecurityMgrRealm.java:220)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:553)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.valves.CertificatesValve.invoke(CertificatesValve.java:246)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.jboss.web.tomcat.tc4.statistics.ContainerStatsValve.invoke(ContainerStatsValve.java:76)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.catalina.core.StandardContext.invoke(StandardContext.java:2417)
ERROR [STDERR] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:180)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.apache.catalina.valves.ErrorDispatcherValve.invoke(ErrorDispatcherValve.java:171)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:172)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:65)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:577)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:174)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter.java:197)
ERROR [STDERR] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:781)
ERROR [STDERR] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:549)
ERROR [STDERR] at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:605)
ERROR [STDERR] at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:677)
ERROR [STDERR] at java.lang.Thread.run(Thread.java:534)
ERROR [STDERR] org.apache.commons.transaction.file.ResourceManagerSystemException: TP-Processor3-1106733590687-5: Failed to undo
change / create of '/files/public/bla.blubb_1.0' (ERR_SYSTEM)
ERROR [STDERR] at
org.apache.commons.transaction.file.FileResourceManager.undoScheduledChangeOrCreate(FileResourceManager.java:1015)
ERROR [STDERR] at org.apache.commons.transaction.file.FileResourceManager.deleteResource(FileResourceManager.java:724)
ERROR [STDERR] at org.apache.commons.transaction.file.FileResourceManager.deleteResource(FileResourceManager.java:704)
ERROR [STDERR] at org.apache.slide.store.txfile.TxFileContentStore.storeRevisionContent(TxFileContentStore.java:116)
ERROR [STDERR] at org.apache.slide.store.txfile.TxFileContentStore.createRevisionContent(TxFileContentStore.java:84)
ERROR [STDERR] at org.apache.slide.store.AbstractStore.createRevisionContent(AbstractStore.java:1515)
ERROR [STDERR] at org.apache.slide.store.ExtendedStore.createRevisionContent(ExtendedStore.java:516)
ERROR [STDERR] at org.apache.slide.content.ContentImpl.create(ContentImpl.java:548)
ERROR [STDERR] at org.apache.slide.webdav.method.PutMethod.executeRequest(PutMethod.java:427)
ERROR [STDERR] at org.apache.slide.webdav.method.AbstractWebdavMethod.executeRedirect(AbstractWebdavMethod.java:584)
ERROR [STDERR] at org.apache.slide.webdav.method.AbstractWebdavMethod.run(AbstractWebdavMethod.java:425)
ERROR [STDERR] at org.apache.slide.webdav.WebdavServlet.service(WebdavServlet.java:151)
ERROR [STDERR] at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:247)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193)
ERROR [STDERR] at org.apache.slide.webdav.filter.LogFilter.doFilter(LogFilter.java:141)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:213)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193)
ERROR [STDERR] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:256)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.jboss.web.tomcat.security.JBossSecurityMgrRealm.invoke(JBossSecurityMgrRealm.java:220)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:553)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.valves.CertificatesValve.invoke(CertificatesValve.java:246)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.jboss.web.tomcat.tc4.statistics.ContainerStatsValve.invoke(ContainerStatsValve.java:76)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.catalina.core.StandardContext.invoke(StandardContext.java:2417)
ERROR [STDERR] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:180)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.apache.catalina.valves.ErrorDispatcherValve.invoke(ErrorDispatcherValve.java:171)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:172)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:65)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:577)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:174)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter.java:197)
ERROR [STDERR] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:781)
ERROR [STDERR] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:549)
ERROR [STDERR] at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:605)
ERROR [STDERR] at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:677)
ERROR [STDERR] at java.lang.Thread.run(Thread.java:534)
ERROR [STDERR] org.apache.slide.common.ServiceAccessException: Service TxContentFileStore at D:/Slide/server/store/content working
on D:/Slide/server/work/content access error : TP-Processor3-1106733590687-5: Failed to undo change / create of
'/files/public/bla.blubb_1.0' (ERR_SYSTEM)
ERROR [STDERR] at org.apache.slide.store.txfile.AbstractTxFileStoreService.throwInternalError(AbstractTxFileStoreService.java:444)
ERROR [STDERR] at org.apache.slide.store.txfile.TxFileContentStore.storeRevisionContent(TxFileContentStore.java:126)
ERROR [STDERR] at org.apache.slide.store.txfile.TxFileContentStore.createRevisionContent(TxFileContentStore.java:84)
ERROR [STDERR] at org.apache.slide.store.AbstractStore.createRevisionContent(AbstractStore.java:1515)
ERROR [STDERR] at org.apache.slide.store.ExtendedStore.createRevisionContent(ExtendedStore.java:516)
ERROR [STDERR] at org.apache.slide.content.ContentImpl.create(ContentImpl.java:548)
ERROR [STDERR] at org.apache.slide.webdav.method.PutMethod.executeRequest(PutMethod.java:427)
ERROR [STDERR] at org.apache.slide.webdav.method.AbstractWebdavMethod.executeRedirect(AbstractWebdavMethod.java:584)
ERROR [STDERR] at org.apache.slide.webdav.method.AbstractWebdavMethod.run(AbstractWebdavMethod.java:425)
ERROR [STDERR] at org.apache.slide.webdav.WebdavServlet.service(WebdavServlet.java:151)
ERROR [STDERR] at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:247)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193)
ERROR [STDERR] at org.apache.slide.webdav.filter.LogFilter.doFilter(LogFilter.java:141)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:213)
ERROR [STDERR] at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:193)
ERROR [STDERR] at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:256)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.jboss.web.tomcat.security.JBossSecurityMgrRealm.invoke(JBossSecurityMgrRealm.java:220)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:553)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.valves.CertificatesValve.invoke(CertificatesValve.java:246)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.jboss.web.tomcat.tc4.statistics.ContainerStatsValve.invoke(ContainerStatsValve.java:76)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.catalina.core.StandardContext.invoke(StandardContext.java:2417)
ERROR [STDERR] at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:180)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.apache.catalina.valves.ErrorDispatcherValve.invoke(ErrorDispatcherValve.java:171)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:172)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:65)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:577)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:641)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:174)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext(StandardPipeline.java:643)
ERROR [STDERR] at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:480)
ERROR [STDERR] at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995)
ERROR [STDERR] at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter.java:197)
ERROR [STDERR] at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:781)
ERROR [STDERR] at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection(Http11Protocol.java:549)
ERROR [STDERR] at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:605)
ERROR [STDERR] at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:677)
ERROR [STDERR] at java.lang.Thread.run(Thread.java:534)
INFO [STDOUT] TP-Processor3, 26-Jan-2005 10:59:50, sep, PUT, 500 "Internal Server Error", 657 ms, /files/public/bla.blubb
>-----Original Message-----
>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>Sent: Wednesday, January 26, 2005 9:04 AM
>To: Slide Developers Mailing List
>Subject: Re: file size limitation in slide 2.1 final
>
>
>Does a file that is a bit smaller than 2 GB work? If so maybe there
>are places inside the Slide code that use integers which can only
>represent up to 2 GB...
>
>Oliver
>
>
>On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
><sv...@innoface.de> wrote:
>> Hello again,
>>
>> I just tried it again.
>>
>> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
>>
>> Again I tried to put a large file (>4 GB), I am getting
>>
>> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
>>
>> and the file is created, but it has just 287 MB.
>>
>> When trying to put a smaller file (780 MB) everything works fine.
>>
>> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS
>is about 16
>> EB or so.
>>
>> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the org.apache.slide.store.txfile.TxFileContentStore.
>>
>> And I put the file on it using WindowsXPs netfolders.
>>
>> Has anyone an idea why I can't upload larger files?
>>
>> thanks in advance
>> SVen
>>
>> >-----Original Message-----
>> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>>
>> >Sent: Friday, January 07, 2005 3:21 PM
>> >To: Sven Pfeiffer
>> >Cc: Slide Developers Mailing List
>> >Subject: Re: file size limitation in slide 2.1 final
>> >
>> >
>> >OK, I just tried it with my installation (built from Slide head,
>> >however) and I just copied a file more than 600MB long and it worked.
>> >
>> >What I have seen from the 2.1 sources is that when the client does not
>> >pass the content length, the whole file is buffered in memory to find
>> >it out. This is different in the Slide head.
>> >
>> >I did my test with Windows web folders which correctly passes the length anyway.
>> >
>> >Maybe this is somewhat related to your problem?
>> >
>> >Oliver
>> >
>> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
>> ><sv...@innoface.de> wrote:
>> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
>> >the real size
>> >> 561 MB which is also shown on the server.
>> >>
>> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than it stops.
>> >the client
>> >> seems to continue copying for about 5 minutes.
>> >>
>> >> the system returns 201 (created)
>> >>
>> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
>> >>
>> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
>> >>
>> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
>> >>
>> >> thank you for your support
>> >>
>> >> SVen
>> >>
>> >> >-----Original Message-----
>> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >Sent: Friday, January 07, 2005 2:50 PM
>> >> >To: Sven Pfeiffer
>> >> >Cc: Slide Developers Mailing List
>> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >
>> >> >
>> >> >What do the properties say? The original size? Does your file system
>> >> >support larger files?
>> >> >
>> >> >Oliver
>> >> >
>> >> >
>> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
>> >> ><sv...@innoface.de> wrote:
>> >> >> TxFileContentStore
>> >> >>
>> >> >>
>> >> >> >-----Original Message-----
>> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >> >Sent: Friday, January 07, 2005 2:37 PM
>> >> >> >To: Slide Developers Mailing List
>> >> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >> >
>> >> >> >
>> >> >> >Which store?
>> >> >> >
>> >> >> >Oliver
>> >> >> >
>> >> >> >
>> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
>> >> >> ><sv...@innoface.de> wrote:
>> >> >> >> Hi List
>> >> >> >>
>> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
>> >> >> >>
>> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
>> >> >they are simply
>> >> >> >> cut.
>> >> >> >>
>> >> >> >> Is there a way to avoid this?
>> >> >> >>
>> >> >> >> thanks in advance
>> >> >> >>
>> >> >> >> SVen
>> >> >> >>
>> >> >> >> ---------------------------------------------------------------------
>> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >> >>
>> >> >> >>
>> >> >> >
>> >> >> >---------------------------------------------------------------------
>> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >> >
>> >> >>
>> >> >>
>> >>
>> >>
>> >
>> >---------------------------------------------------------------------
>> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>
>>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: file size limitation in slide 2.1 final
Posted by Oliver Zeigermann <ol...@gmail.com>.
Does a file that is a bit smaller than 2 GB work? If so maybe there
are places inside the Slide code that use integers which can only
represent up to 2 GB...
Oliver
On Wed, 26 Jan 2005 08:59:05 +0100, Sven Pfeiffer
<sv...@innoface.de> wrote:
> Hello again,
>
> I just tried it again.
>
> This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
>
> Again I tried to put a large file (>4 GB), I am getting
>
> TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
>
> and the file is created, but it has just 287 MB.
>
> When trying to put a smaller file (780 MB) everything works fine.
>
> I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS is about 16
> EB or so.
>
> I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the org.apache.slide.store.txfile.TxFileContentStore.
>
> And I put the file on it using WindowsXPs netfolders.
>
> Has anyone an idea why I can't upload larger files?
>
> thanks in advance
> SVen
>
> >-----Original Message-----
> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>
> >Sent: Friday, January 07, 2005 3:21 PM
> >To: Sven Pfeiffer
> >Cc: Slide Developers Mailing List
> >Subject: Re: file size limitation in slide 2.1 final
> >
> >
> >OK, I just tried it with my installation (built from Slide head,
> >however) and I just copied a file more than 600MB long and it worked.
> >
> >What I have seen from the 2.1 sources is that when the client does not
> >pass the content length, the whole file is buffered in memory to find
> >it out. This is different in the Slide head.
> >
> >I did my test with Windows web folders which correctly passes the length anyway.
> >
> >Maybe this is somewhat related to your problem?
> >
> >Oliver
> >
> >On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
> ><sv...@innoface.de> wrote:
> >> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
> >the real size
> >> 561 MB which is also shown on the server.
> >>
> >> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than it stops.
> >the client
> >> seems to continue copying for about 5 minutes.
> >>
> >> the system returns 201 (created)
> >>
> >> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
> >>
> >> and i don't think that the filesystem (NTFS) has a problem with larger files.
> >>
> >> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
> >>
> >> thank you for your support
> >>
> >> SVen
> >>
> >> >-----Original Message-----
> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >> >Sent: Friday, January 07, 2005 2:50 PM
> >> >To: Sven Pfeiffer
> >> >Cc: Slide Developers Mailing List
> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >
> >> >
> >> >What do the properties say? The original size? Does your file system
> >> >support larger files?
> >> >
> >> >Oliver
> >> >
> >> >
> >> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
> >> ><sv...@innoface.de> wrote:
> >> >> TxFileContentStore
> >> >>
> >> >>
> >> >> >-----Original Message-----
> >> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >> >> >Sent: Friday, January 07, 2005 2:37 PM
> >> >> >To: Slide Developers Mailing List
> >> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >> >
> >> >> >
> >> >> >Which store?
> >> >> >
> >> >> >Oliver
> >> >> >
> >> >> >
> >> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
> >> >> ><sv...@innoface.de> wrote:
> >> >> >> Hi List
> >> >> >>
> >> >> >> there seems to be a limitation of the file site in slide 2.1 final.
> >> >> >>
> >> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
> >> >they are simply
> >> >> >> cut.
> >> >> >>
> >> >> >> Is there a way to avoid this?
> >> >> >>
> >> >> >> thanks in advance
> >> >> >>
> >> >> >> SVen
> >> >> >>
> >> >> >> ---------------------------------------------------------------------
> >> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >> >>
> >> >> >>
> >> >> >
> >> >> >---------------------------------------------------------------------
> >> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >> >
> >> >>
> >> >>
> >>
> >>
> >
> >---------------------------------------------------------------------
> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
RE: file size limitation in slide 2.1 final
Posted by Sven Pfeiffer <sv...@innoface.de>.
Hello again,
I just tried it again.
This time I build Slide myself, from Slide head, just downloaded the sources yesterday.
Again I tried to put a large file (>4 GB), I am getting
TP-Processor3, 26-Jan-2005 08:30:04, sep, PUT, 204 "No Content", 87703 ms, /files/public/1suse.iso
and the file is created, but it has just 287 MB.
When trying to put a smaller file (780 MB) everything works fine.
I can't imaging this has something to do with a limitation of the filesystem, because afaik the maximum filesize of NTFS is about 16
EB or so.
I tried it running slide on Windows 2000, inside a JBoss/Tomcat using the org.apache.slide.store.txfile.TxFileContentStore.
And I put the file on it using WindowsXPs netfolders.
Has anyone an idea why I can't upload larger files?
thanks in advance
SVen
>-----Original Message-----
>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>Sent: Friday, January 07, 2005 3:21 PM
>To: Sven Pfeiffer
>Cc: Slide Developers Mailing List
>Subject: Re: file size limitation in slide 2.1 final
>
>
>OK, I just tried it with my installation (built from Slide head,
>however) and I just copied a file more than 600MB long and it worked.
>
>What I have seen from the 2.1 sources is that when the client does not
>pass the content length, the whole file is buffered in memory to find
>it out. This is different in the Slide head.
>
>I did my test with Windows web folders which correctly passes the length anyway.
>
>Maybe this is somewhat related to your problem?
>
>Oliver
>
>On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
><sv...@innoface.de> wrote:
>> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows
>the real size
>> 561 MB which is also shown on the server.
>>
>> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than it stops.
>the client
>> seems to continue copying for about 5 minutes.
>>
>> the system returns 201 (created)
>>
>> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
>>
>> and i don't think that the filesystem (NTFS) has a problem with larger files.
>>
>> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
>>
>> thank you for your support
>>
>> SVen
>>
>> >-----Original Message-----
>> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >Sent: Friday, January 07, 2005 2:50 PM
>> >To: Sven Pfeiffer
>> >Cc: Slide Developers Mailing List
>> >Subject: Re: file size limitation in slide 2.1 final
>> >
>> >
>> >What do the properties say? The original size? Does your file system
>> >support larger files?
>> >
>> >Oliver
>> >
>> >
>> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
>> ><sv...@innoface.de> wrote:
>> >> TxFileContentStore
>> >>
>> >>
>> >> >-----Original Message-----
>> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>> >> >Sent: Friday, January 07, 2005 2:37 PM
>> >> >To: Slide Developers Mailing List
>> >> >Subject: Re: file size limitation in slide 2.1 final
>> >> >
>> >> >
>> >> >Which store?
>> >> >
>> >> >Oliver
>> >> >
>> >> >
>> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
>> >> ><sv...@innoface.de> wrote:
>> >> >> Hi List
>> >> >>
>> >> >> there seems to be a limitation of the file site in slide 2.1 final.
>> >> >>
>> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
>> >they are simply
>> >> >> cut.
>> >> >>
>> >> >> Is there a way to avoid this?
>> >> >>
>> >> >> thanks in advance
>> >> >>
>> >> >> SVen
>> >> >>
>> >> >> ---------------------------------------------------------------------
>> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >>
>> >> >>
>> >> >
>> >> >---------------------------------------------------------------------
>> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>> >> >
>> >>
>> >>
>>
>>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: file size limitation in slide 2.1 final
Posted by Oliver Zeigermann <ol...@gmail.com>.
OK, I just tried it with my installation (built from Slide head,
however) and I just copied a file more than 600MB long and it worked.
What I have seen from the 2.1 sources is that when the client does not
pass the content length, the whole file is buffered in memory to find
it out. This is different in the Slide head.
I did my test with Windows web folders which correctly passes the length anyway.
Maybe this is somewhat related to your problem?
Oliver
On Fri, 7 Jan 2005 14:58:57 +0100, Sven Pfeiffer
<sv...@innoface.de> wrote:
> on the system from wich i upload the file the properties first say the original size (8,7 GB), after refresh it shows the real size
> 561 MB which is also shown on the server.
>
> if i take a look at the work/content folder the filesize constantly increases until it reaches the 561 MB than it stops. the client
> seems to continue copying for about 5 minutes.
>
> the system returns 201 (created)
>
> the server is running on a windows 2k computer, of course there is enough free disk space ;o)
>
> and i don't think that the filesystem (NTFS) has a problem with larger files.
>
> i think it is to aovid the OutOfMemoryError that I received in the earlier version of slide, but I am not sure.
>
> thank you for your support
>
> SVen
>
> >-----Original Message-----
> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >Sent: Friday, January 07, 2005 2:50 PM
> >To: Sven Pfeiffer
> >Cc: Slide Developers Mailing List
> >Subject: Re: file size limitation in slide 2.1 final
> >
> >
> >What do the properties say? The original size? Does your file system
> >support larger files?
> >
> >Oliver
> >
> >
> >On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
> ><sv...@innoface.de> wrote:
> >> TxFileContentStore
> >>
> >>
> >> >-----Original Message-----
> >> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >> >Sent: Friday, January 07, 2005 2:37 PM
> >> >To: Slide Developers Mailing List
> >> >Subject: Re: file size limitation in slide 2.1 final
> >> >
> >> >
> >> >Which store?
> >> >
> >> >Oliver
> >> >
> >> >
> >> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
> >> ><sv...@innoface.de> wrote:
> >> >> Hi List
> >> >>
> >> >> there seems to be a limitation of the file site in slide 2.1 final.
> >> >>
> >> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files
> >they are simply
> >> >> cut.
> >> >>
> >> >> Is there a way to avoid this?
> >> >>
> >> >> thanks in advance
> >> >>
> >> >> SVen
> >> >>
> >> >> ---------------------------------------------------------------------
> >> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >>
> >> >>
> >> >
> >> >---------------------------------------------------------------------
> >> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >> >
> >>
> >>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: file size limitation in slide 2.1 final
Posted by Oliver Zeigermann <ol...@gmail.com>.
What do the properties say? The original size? Does your file system
support larger files?
Oliver
On Fri, 7 Jan 2005 14:42:14 +0100, Sven Pfeiffer
<sv...@innoface.de> wrote:
> TxFileContentStore
>
>
> >-----Original Message-----
> >From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
> >Sent: Friday, January 07, 2005 2:37 PM
> >To: Slide Developers Mailing List
> >Subject: Re: file size limitation in slide 2.1 final
> >
> >
> >Which store?
> >
> >Oliver
> >
> >
> >On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
> ><sv...@innoface.de> wrote:
> >> Hi List
> >>
> >> there seems to be a limitation of the file site in slide 2.1 final.
> >>
> >> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files they are simply
> >> cut.
> >>
> >> Is there a way to avoid this?
> >>
> >> thanks in advance
> >>
> >> SVen
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >>
> >>
> >
> >---------------------------------------------------------------------
> >To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> >For additional commands, e-mail: slide-dev-help@jakarta.apache.org
> >
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
RE: file size limitation in slide 2.1 final
Posted by Sven Pfeiffer <sv...@innoface.de>.
TxFileContentStore
>-----Original Message-----
>From: Oliver Zeigermann [mailto:oliver.zeigermann@gmail.com]
>Sent: Friday, January 07, 2005 2:37 PM
>To: Slide Developers Mailing List
>Subject: Re: file size limitation in slide 2.1 final
>
>
>Which store?
>
>Oliver
>
>
>On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
><sv...@innoface.de> wrote:
>> Hi List
>>
>> there seems to be a limitation of the file site in slide 2.1 final.
>>
>> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files they are simply
>> cut.
>>
>> Is there a way to avoid this?
>>
>> thanks in advance
>>
>> SVen
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>>
>>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org
Re: file size limitation in slide 2.1 final
Posted by Oliver Zeigermann <ol...@gmail.com>.
Which store?
Oliver
On Fri, 7 Jan 2005 14:33:40 +0100, Sven Pfeiffer
<sv...@innoface.de> wrote:
> Hi List
>
> there seems to be a limitation of the file site in slide 2.1 final.
>
> no matter how large the files are, if they are larger than round about 561 MB and if I want to store larger files they are simply
> cut.
>
> Is there a way to avoid this?
>
> thanks in advance
>
> SVen
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: slide-dev-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: slide-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: slide-dev-help@jakarta.apache.org