You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-dev@axis.apache.org by "Marc Dumontier (JIRA)" <ax...@ws.apache.org> on 2005/03/14 19:25:09 UTC
[jira] Created: (AXIS-1872) Allow for streaming of DIME attachments
Allow for streaming of DIME attachments
---------------------------------------
Key: AXIS-1872
URL: http://issues.apache.org/jira/browse/AXIS-1872
Project: Axis
Type: New Feature
Components: SAAJ
Versions: 1.2RC3
Reporter: Marc Dumontier
Attachments: dime-patch.txt
The current system does not allow for streaming DIME attachments because the size of the data is requested from the DataHandler first (this usually means reading the entire stream, then resetting it), and then a single DIME record is created.
The DIME specification allows for the use of record chunking so that dynamic content generators can stream back data with a small memory footprint.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
If you want more information on JIRA, or have a bug to report see:
http://www.atlassian.com/software/jira
[jira] Updated: (AXIS-1872) Allow for streaming of DIME attachments
Posted by "Marc Dumontier (JIRA)" <ax...@ws.apache.org>.
[ http://issues.apache.org/jira/browse/AXIS-1872?page=history ]
Marc Dumontier updated AXIS-1872:
---------------------------------
Attachment: DimeBodyPart.diff
diff -u version
> Allow for streaming of DIME attachments
> ---------------------------------------
>
> Key: AXIS-1872
> URL: http://issues.apache.org/jira/browse/AXIS-1872
> Project: Axis
> Type: New Feature
> Components: SAAJ
> Versions: 1.2RC3
> Reporter: Marc Dumontier
> Attachments: DimeBodyPart.diff, DynamicContentDataHandler.java, dime-patch.txt
>
> The current system does not allow for streaming DIME attachments because the size of the data is requested from the DataHandler first (this usually means reading the entire stream, then resetting it), and then a single DIME record is created.
> The DIME specification allows for the use of record chunking so that dynamic content generators can stream back data with a small memory footprint.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
If you want more information on JIRA, or have a bug to report see:
http://www.atlassian.com/software/jira
[jira] Commented: (AXIS-1872) Allow for streaming of DIME attachments
Posted by "Brian Husted (JIRA)" <ax...@ws.apache.org>.
[ http://issues.apache.org/jira/browse/AXIS-1872?page=comments#action_12315785 ]
Brian Husted commented on AXIS-1872:
------------------------------------
Unfortunutely, I have run into some difficulties regarding streaming attachments using DIME with the Axis patch. It works fine when submitting attachments from the Axis server to the Axis client. However, when I attempt to submit an attachment from the Axis client to the Axis server running the Web Services it has problems. I am using Axis version 1.2.1, running the client in Java JDK 1.4.2_05 and server running Weblogic 7 on JDK 1.3.1.
Below is the server side stack trace:
java.io.IOException: End of physical stream detected when 11 more bytes expected.
at org.apache.axis.attachments.DimeDelimitedInputStream._read(DimeDelimitedInputStream.java:273)
at org.apache.axis.attachments.DimeDelimitedInputStream.read(DimeDelimitedInputStream.java:201)
at org.apache.axis.attachments.DimeDelimitedInputStream.read(DimeDelimitedInputStream.java:445)
at org.apache.axis.attachments.ManagedMemoryDataSource.<init>(ManagedMemoryDataSource.java:146)
at org.apache.axis.attachments.MultiPartDimeInputStream.readTillFound(MultiPartDimeInputStream.java:163)
at org.apache.axis.attachments.MultiPartDimeInputStream.readAll(MultiPartDimeInputStream.java:100)
at org.apache.axis.attachments.MultiPartDimeInputStream.getAttachments(MultiPartDimeInputStream.java:108)
at org.apache.axis.attachments.AttachmentsImpl.mergeinAttachments(AttachmentsImpl.java:156)
at org.apache.axis.attachments.AttachmentsImpl.getAttachmentCount(AttachmentsImpl.java:515)
> Allow for streaming of DIME attachments
> ---------------------------------------
>
> Key: AXIS-1872
> URL: http://issues.apache.org/jira/browse/AXIS-1872
> Project: Apache Axis
> Type: New Feature
> Components: SAAJ
> Versions: 1.2RC3
> Reporter: Marc Dumontier
> Attachments: DimeBodyPart.diff, DynamicContentDataHandler.java, dime-patch.txt
>
> The current system does not allow for streaming DIME attachments because the size of the data is requested from the DataHandler first (this usually means reading the entire stream, then resetting it), and then a single DIME record is created.
> The DIME specification allows for the use of record chunking so that dynamic content generators can stream back data with a small memory footprint.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Resolved: (AXIS-1872) Allow for streaming of DIME attachments
Posted by "Davanum Srinivas (JIRA)" <ax...@ws.apache.org>.
[ http://issues.apache.org/jira/browse/AXIS-1872?page=history ]
Davanum Srinivas resolved AXIS-1872:
------------------------------------
Resolution: Fixed
Applied Patch.
thanks,
dims
> Allow for streaming of DIME attachments
> ---------------------------------------
>
> Key: AXIS-1872
> URL: http://issues.apache.org/jira/browse/AXIS-1872
> Project: Axis
> Type: New Feature
> Components: SAAJ
> Versions: 1.2RC3
> Reporter: Marc Dumontier
> Attachments: DimeBodyPart.diff, DynamicContentDataHandler.java, dime-patch.txt
>
> The current system does not allow for streaming DIME attachments because the size of the data is requested from the DataHandler first (this usually means reading the entire stream, then resetting it), and then a single DIME record is created.
> The DIME specification allows for the use of record chunking so that dynamic content generators can stream back data with a small memory footprint.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
If you want more information on JIRA, or have a bug to report see:
http://www.atlassian.com/software/jira
[jira] Updated: (AXIS-1872) Allow for streaming of DIME attachments
Posted by "Marc Dumontier (JIRA)" <ax...@ws.apache.org>.
[ http://issues.apache.org/jira/browse/AXIS-1872?page=history ]
Marc Dumontier updated AXIS-1872:
---------------------------------
Attachment: dime-patch.txt
I wrote a small patch for axis 1.2 RC3 to allow me to take advantage
> DIME record chunking. This allows people who generate dynamic content
> who don't know the size of their data beforehand to stream out.
>
> I've been streaming 2GB+ attachments out with no problem.
>
> Using it is very simple
>
> for example:
>
> DynamicContentDataHandler datahandler = null;
> URL url = new URL("http",host,port,QUERY_STRING);
> URLDataSource dataSource = new URLDataSource(url);
> datahandler = new DynamicContentDataHandler(dataSource);
> datahandler.setChunkSize(10 * 1024 * 1024);
>
> This will make dime record chunks of 10MB, and only buffer 20MB of data
> at any one time.
>
>
>
> Allow for streaming of DIME attachments
> ---------------------------------------
>
> Key: AXIS-1872
> URL: http://issues.apache.org/jira/browse/AXIS-1872
> Project: Axis
> Type: New Feature
> Components: SAAJ
> Versions: 1.2RC3
> Reporter: Marc Dumontier
> Attachments: dime-patch.txt
>
> The current system does not allow for streaming DIME attachments because the size of the data is requested from the DataHandler first (this usually means reading the entire stream, then resetting it), and then a single DIME record is created.
> The DIME specification allows for the use of record chunking so that dynamic content generators can stream back data with a small memory footprint.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
If you want more information on JIRA, or have a bug to report see:
http://www.atlassian.com/software/jira
[jira] Updated: (AXIS-1872) Allow for streaming of DIME attachments
Posted by "Marc Dumontier (JIRA)" <ax...@ws.apache.org>.
[ http://issues.apache.org/jira/browse/AXIS-1872?page=history ]
Marc Dumontier updated AXIS-1872:
---------------------------------
Attachment: DynamicContentDataHandler.java
> Allow for streaming of DIME attachments
> ---------------------------------------
>
> Key: AXIS-1872
> URL: http://issues.apache.org/jira/browse/AXIS-1872
> Project: Axis
> Type: New Feature
> Components: SAAJ
> Versions: 1.2RC3
> Reporter: Marc Dumontier
> Attachments: DimeBodyPart.diff, DynamicContentDataHandler.java, dime-patch.txt
>
> The current system does not allow for streaming DIME attachments because the size of the data is requested from the DataHandler first (this usually means reading the entire stream, then resetting it), and then a single DIME record is created.
> The DIME specification allows for the use of record chunking so that dynamic content generators can stream back data with a small memory footprint.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
If you want more information on JIRA, or have a bug to report see:
http://www.atlassian.com/software/jira