You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-dev@axis.apache.org by Matt Friedman <ma...@gmail.com> on 2007/06/28 04:57:10 UTC

MTOM Performance Question

Sorry to double post. I already posted this on the users list but
didn't get any replies:

I've been searching and found some performance issues mentioned in JIRA re MTOM.

We were able to create an Axis2 server and client that uses MTOM and
the throughput appears to be very slow. 2 mbits/s on a network that
should run at 5 Megabytes/s - I acknowledge that there might be other
bottlenecks but I do know that the network is reasonably fast.

Can anyone confirm/deny or otherwise comment on the status of any
performance issues to do with the MTOM implementation in Axis2? Should
we be able to get decently fast file transfers using MTOM?

Overall, have performance issues been resolved?

Many thanks,

-- 
-- Matt Friedman

---------------------------------------------------------------------
To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
For additional commands, e-mail: axis-dev-help@ws.apache.org


Re: MTOM Performance Question

Posted by Matt Friedman <ma...@gmail.com>.
In any event we will use MTOM. We're not going to use SwA for various
internal reasons.

To explain my previous statement, on the server end we will be handling a
stream from yet another remote source that will get sent to the client using
MTOM. So, we're getting a stream resource from another server in response to
a client request and that resource will get sent to our client.  I expect
we'll write a custom DataHandler so that it can point to the stream
resource.

I read the links you sent. Looks like link [2] shows the best way to move
forward.

Thanks again.
Matt.


On 6/29/07, Thilina Gunarathne <cs...@gmail.com> wrote:
>
> > > about the data binding mechanism..
> > Can you be more specific?
> Axis2 provides several data binding mechanism which can be used to
> generate MTOM messages using a WSDL which has bese64Binary elements.
> One example is ADB.. XMLBeans data binding also had MTOM support, but
> I'm not sure whether it's working at the moment...
>
> You can use MTOM even without data binding using an Axiom based approach..
>
> > We'll be dealing with streams so whatever the source of the file it will
> be
> > abstracted as a stream object.
> Hmm...Can you explain this a bit... May be you might need to look in
> to attachment streaming functionality too..
>
> Thanks,
> Thilina
>
> [1]MTOM Guide -Sending Binary Data with SOAP -
> http://ws.apache.org/axis2/1_2/mtom-guide.html
>
> [2] Binary with ADB  - http://wso2.org/library/236
>
>
> >
> >
> >
> >
> >  On 6/29/07, Thilina Gunarathne <cs...@gmail.com> wrote:
> > > One thing I forgot to mention is about the data binding mechanism..
> > > That can also effect the MTOM performance...
> > >
> > > Thanks,l
> > > Thilina
> > >
> > > On 6/28/07, Matt Friedman < matt.friedman@gmail.com> wrote:
> > > > Ok, great. Basically I was just looking for confirmation that we can
> > expect
> > > > good rates using MTOM once we work through all bottleneck issues on
> our
> > end.
> > > >
> > > > Thanks very much for the assistance and support.
> > > >
> > > >
> > > >  On 6/28/07, Thilina Gunarathne <cs...@gmail.com> wrote:
> > > > >
> > > > > > Overall, have performance issues been resolved?
> > > > > yes... We fixed all performance issues that were reported in the
> JIRA+
> > > > > more... We were able to upload files in to a server running in the
> > > > > local machine with a speed ~ 5MegaBytes/s... (720 MB file in 2.3
> > > > > minutes)... We were using FileDataSource to read in the attachment
> and
> > > > > used file caching in the server side...
> > > > >
> > > > > There can also be other issues like how you are reading in the
> > > > > attachment before sending, what extra processing you are doing at
> the
> > > > > server, etc,etc...
> > > > >
> > > > > Thanks,
> > > > > Thilina
> > > > > >
> > > > > > Many thanks,
> > > > > >
> > > > > > --
> > > > > > -- Matt Friedman
> > > > > >
> > > > > >
> > > >
> > ---------------------------------------------------------------------
> > > > > > To unsubscribe, e-mail:
> > > > axis-dev-unsubscribe@ws.apache.org
> > > > > > For additional commands, e-mail: axis-dev-help@ws.apache.org
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Thilina Gunarathne  -   http://www.wso2.com -
> > http://thilinag.blogspot.com
> > > > >
> > > > >
> > > >
> > ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail:
> > > > axis-dev-unsubscribe@ws.apache.org
> > > > > For additional commands, e-mail: axis-dev-help@ws.apache.org
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > -- Matt Friedman
> > > >
> > > >
> > >
> > >
> > > --
> > > Thilina Gunarathne  -  http://www.wso2.com -
> http://thilinag.blogspot.com
> > >
> > >
> > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail:
> > axis-dev-unsubscribe@ws.apache.org
> > > For additional commands, e-mail: axis-dev-help@ws.apache.org
> > >
> > >
> >
> >
> >
> > --
> > -- Matt Friedman
> >
> >
>
>
> --
> Thilina Gunarathne  -  http://www.wso2.com - http://thilinag.blogspot.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
> For additional commands, e-mail: axis-dev-help@ws.apache.org
>
>


-- 
-- Matt Friedman

Re: MTOM Performance Question

Posted by Thilina Gunarathne <cs...@gmail.com>.
> > about the data binding mechanism..
> Can you be more specific?
Axis2 provides several data binding mechanism which can be used to
generate MTOM messages using a WSDL which has bese64Binary elements.
One example is ADB.. XMLBeans data binding also had MTOM support, but
I'm not sure whether it's working at the moment...

You can use MTOM even without data binding using an Axiom based approach..

> We'll be dealing with streams so whatever the source of the file it will be
> abstracted as a stream object.
Hmm...Can you explain this a bit... May be you might need to look in
to attachment streaming functionality too..

Thanks,
Thilina

[1]MTOM Guide -Sending Binary Data with SOAP -
http://ws.apache.org/axis2/1_2/mtom-guide.html

[2] Binary with ADB  - http://wso2.org/library/236


>
>
>
>
>  On 6/29/07, Thilina Gunarathne <cs...@gmail.com> wrote:
> > One thing I forgot to mention is about the data binding mechanism..
> > That can also effect the MTOM performance...
> >
> > Thanks,l
> > Thilina
> >
> > On 6/28/07, Matt Friedman < matt.friedman@gmail.com> wrote:
> > > Ok, great. Basically I was just looking for confirmation that we can
> expect
> > > good rates using MTOM once we work through all bottleneck issues on our
> end.
> > >
> > > Thanks very much for the assistance and support.
> > >
> > >
> > >  On 6/28/07, Thilina Gunarathne <cs...@gmail.com> wrote:
> > > >
> > > > > Overall, have performance issues been resolved?
> > > > yes... We fixed all performance issues that were reported in the JIRA+
> > > > more... We were able to upload files in to a server running in the
> > > > local machine with a speed ~ 5MegaBytes/s... (720 MB file in 2.3
> > > > minutes)... We were using FileDataSource to read in the attachment and
> > > > used file caching in the server side...
> > > >
> > > > There can also be other issues like how you are reading in the
> > > > attachment before sending, what extra processing you are doing at the
> > > > server, etc,etc...
> > > >
> > > > Thanks,
> > > > Thilina
> > > > >
> > > > > Many thanks,
> > > > >
> > > > > --
> > > > > -- Matt Friedman
> > > > >
> > > > >
> > >
> ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail:
> > > axis-dev-unsubscribe@ws.apache.org
> > > > > For additional commands, e-mail: axis-dev-help@ws.apache.org
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Thilina Gunarathne  -   http://www.wso2.com -
> http://thilinag.blogspot.com
> > > >
> > > >
> > >
> ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail:
> > > axis-dev-unsubscribe@ws.apache.org
> > > > For additional commands, e-mail: axis-dev-help@ws.apache.org
> > > >
> > > >
> > >
> > >
> > >
> > > --
> > > -- Matt Friedman
> > >
> > >
> >
> >
> > --
> > Thilina Gunarathne  -  http://www.wso2.com - http://thilinag.blogspot.com
> >
> >
> ---------------------------------------------------------------------
> > To unsubscribe, e-mail:
> axis-dev-unsubscribe@ws.apache.org
> > For additional commands, e-mail: axis-dev-help@ws.apache.org
> >
> >
>
>
>
> --
> -- Matt Friedman
>
>


-- 
Thilina Gunarathne  -  http://www.wso2.com - http://thilinag.blogspot.com

---------------------------------------------------------------------
To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
For additional commands, e-mail: axis-dev-help@ws.apache.org


Re: MTOM Performance Question

Posted by Matt Friedman <ma...@gmail.com>.
> about the data binding mechanism..
Can you be more specific?

We'll be dealing with streams so whatever the source of the file it will be
abstracted as a stream object.



On 6/29/07, Thilina Gunarathne <cs...@gmail.com> wrote:
>
> One thing I forgot to mention is about the data binding mechanism..
> That can also effect the MTOM performance...
>
> Thanks,l
> Thilina
>
> On 6/28/07, Matt Friedman <ma...@gmail.com> wrote:
> > Ok, great. Basically I was just looking for confirmation that we can
> expect
> > good rates using MTOM once we work through all bottleneck issues on our
> end.
> >
> > Thanks very much for the assistance and support.
> >
> >
> >  On 6/28/07, Thilina Gunarathne <cs...@gmail.com> wrote:
> > >
> > > > Overall, have performance issues been resolved?
> > > yes... We fixed all performance issues that were reported in the JIRA+
> > > more... We were able to upload files in to a server running in the
> > > local machine with a speed ~ 5MegaBytes/s... (720 MB file in 2.3
> > > minutes)... We were using FileDataSource to read in the attachment and
> > > used file caching in the server side...
> > >
> > > There can also be other issues like how you are reading in the
> > > attachment before sending, what extra processing you are doing at the
> > > server, etc,etc...
> > >
> > > Thanks,
> > > Thilina
> > > >
> > > > Many thanks,
> > > >
> > > > --
> > > > -- Matt Friedman
> > > >
> > > >
> > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail:
> > axis-dev-unsubscribe@ws.apache.org
> > > > For additional commands, e-mail: axis-dev-help@ws.apache.org
> > > >
> > > >
> > >
> > >
> > > --
> > > Thilina Gunarathne  -  http://www.wso2.com -
> http://thilinag.blogspot.com
> > >
> > >
> > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail:
> > axis-dev-unsubscribe@ws.apache.org
> > > For additional commands, e-mail: axis-dev-help@ws.apache.org
> > >
> > >
> >
> >
> >
> > --
> > -- Matt Friedman
> >
> >
>
>
> --
> Thilina Gunarathne  -  http://www.wso2.com - http://thilinag.blogspot.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
> For additional commands, e-mail: axis-dev-help@ws.apache.org
>
>


-- 
-- Matt Friedman

Re: MTOM Performance Question

Posted by Thilina Gunarathne <cs...@gmail.com>.
One thing I forgot to mention is about the data binding mechanism..
That can also effect the MTOM performance...

Thanks,l
Thilina

On 6/28/07, Matt Friedman <ma...@gmail.com> wrote:
> Ok, great. Basically I was just looking for confirmation that we can expect
> good rates using MTOM once we work through all bottleneck issues on our end.
>
> Thanks very much for the assistance and support.
>
>
>  On 6/28/07, Thilina Gunarathne <cs...@gmail.com> wrote:
> >
> > > Overall, have performance issues been resolved?
> > yes... We fixed all performance issues that were reported in the JIRA+
> > more... We were able to upload files in to a server running in the
> > local machine with a speed ~ 5MegaBytes/s... (720 MB file in 2.3
> > minutes)... We were using FileDataSource to read in the attachment and
> > used file caching in the server side...
> >
> > There can also be other issues like how you are reading in the
> > attachment before sending, what extra processing you are doing at the
> > server, etc,etc...
> >
> > Thanks,
> > Thilina
> > >
> > > Many thanks,
> > >
> > > --
> > > -- Matt Friedman
> > >
> > >
> ---------------------------------------------------------------------
> > > To unsubscribe, e-mail:
> axis-dev-unsubscribe@ws.apache.org
> > > For additional commands, e-mail: axis-dev-help@ws.apache.org
> > >
> > >
> >
> >
> > --
> > Thilina Gunarathne  -  http://www.wso2.com - http://thilinag.blogspot.com
> >
> >
> ---------------------------------------------------------------------
> > To unsubscribe, e-mail:
> axis-dev-unsubscribe@ws.apache.org
> > For additional commands, e-mail: axis-dev-help@ws.apache.org
> >
> >
>
>
>
> --
> -- Matt Friedman
>
>


-- 
Thilina Gunarathne  -  http://www.wso2.com - http://thilinag.blogspot.com

---------------------------------------------------------------------
To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
For additional commands, e-mail: axis-dev-help@ws.apache.org


Re: MTOM Performance Question

Posted by Matt Friedman <ma...@gmail.com>.
Ok, great. Basically I was just looking for confirmation that we can expect
good rates using MTOM once we work through all bottleneck issues on our end.


Thanks very much for the assistance and support.

On 6/28/07, Thilina Gunarathne <cs...@gmail.com> wrote:
>
> > Overall, have performance issues been resolved?
> yes... We fixed all performance issues that were reported in the JIRA+
> more... We were able to upload files in to a server running in the
> local machine with a speed ~ 5MegaBytes/s... (720 MB file in 2.3
> minutes)... We were using FileDataSource to read in the attachment and
> used file caching in the server side...
>
> There can also be other issues like how you are reading in the
> attachment before sending, what extra processing you are doing at the
> server, etc,etc...
>
> Thanks,
> Thilina
> >
> > Many thanks,
> >
> > --
> > -- Matt Friedman
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
> > For additional commands, e-mail: axis-dev-help@ws.apache.org
> >
> >
>
>
> --
> Thilina Gunarathne  -  http://www.wso2.com - http://thilinag.blogspot.com
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
> For additional commands, e-mail: axis-dev-help@ws.apache.org
>
>


-- 
-- Matt Friedman

Re: MTOM Performance Question

Posted by Thilina Gunarathne <cs...@gmail.com>.
> Overall, have performance issues been resolved?
yes... We fixed all performance issues that were reported in the JIRA+
more... We were able to upload files in to a server running in the
local machine with a speed ~ 5MegaBytes/s... (720 MB file in 2.3
minutes)... We were using FileDataSource to read in the attachment and
used file caching in the server side...

There can also be other issues like how you are reading in the
attachment before sending, what extra processing you are doing at the
server, etc,etc...

Thanks,
Thilina
>
> Many thanks,
>
> --
> -- Matt Friedman
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
> For additional commands, e-mail: axis-dev-help@ws.apache.org
>
>


-- 
Thilina Gunarathne  -  http://www.wso2.com - http://thilinag.blogspot.com

---------------------------------------------------------------------
To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
For additional commands, e-mail: axis-dev-help@ws.apache.org


Re: MTOM Performance Question

Posted by Davanum Srinivas <da...@gmail.com>.
What's the size of the attachments? Are you using any data bindings
(on server?, on client?) Have you switched file caching on?
(http://wso2.org/library/264) Are u using Axis2 on both sides? Yes,
there are a whole lot of potential bottlenecks to work through :)
Worst case scenario, you can use the Streaming API in Attachments to
directly read the attachment stream and do whatever you wish. that's
the fastest way on the server to read in the attachments.

thanks,
dims

On 6/27/07, Matt Friedman <ma...@gmail.com> wrote:
> Sorry to double post. I already posted this on the users list but
> didn't get any replies:
>
> I've been searching and found some performance issues mentioned in JIRA re MTOM.
>
> We were able to create an Axis2 server and client that uses MTOM and
> the throughput appears to be very slow. 2 mbits/s on a network that
> should run at 5 Megabytes/s - I acknowledge that there might be other
> bottlenecks but I do know that the network is reasonably fast.
>
> Can anyone confirm/deny or otherwise comment on the status of any
> performance issues to do with the MTOM implementation in Axis2? Should
> we be able to get decently fast file transfers using MTOM?
>
> Overall, have performance issues been resolved?
>
> Many thanks,
>
> --
> -- Matt Friedman
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
> For additional commands, e-mail: axis-dev-help@ws.apache.org
>
>


-- 
Davanum Srinivas :: http://davanum.wordpress.com

---------------------------------------------------------------------
To unsubscribe, e-mail: axis-dev-unsubscribe@ws.apache.org
For additional commands, e-mail: axis-dev-help@ws.apache.org