You are viewing a plain text version of this content. The canonical link for it is here.
Posted to c-dev@axis.apache.org by Selvaratnam Uthaiyashankar <ut...@gmail.com> on 2010/02/24 07:28:05 UTC
Re: Client to receive large data problem
Hi,
What version of Axis2/C you are using? Are you using libxml2 or guththila?
Can you verify whether it is a network related issue? You can capture
the message and see whether server sends all the messages, and the
problem is in client side.
Regards,
Shankar
On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com> wrote:
> Hi,
>
> Does anyone have experience in develop an application using AXIS2C client
> API to consume a web services which returns large amount of data (about 2M).
>
>
>
> When my client application receives such large data, the data will be
> truncated. This problem will get better (but not completely resolved) if I
> add 3 seconds sleep time in axis2_http_client_recieve_header() function in
> the http_client.c. I am hoping by doing so, my application can receive all
> the data before start to process the data. But this does not resolve the
> problem completely, I am wondering if there is any other solution.
>
>
>
> Thanks,
>
> Jan-fon
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-dev-unsubscribe@axis.apache.org
For additional commands, e-mail: c-dev-help@axis.apache.org
RE: Client to receive large data problem
Posted by "Fan, Jan-fon" <ja...@intel.com>.
Hi Shankar,
The data truncation problem happens in my client application which I am using AXIS2/C 1.6 release.
Is there a newer release other than 1.6 that I can use?
Thanks,
Jan-fon
-----Original Message-----
From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
Sent: Wednesday, February 24, 2010 7:59 AM
To: Apache AXIS C Developers List
Cc: Apache AXIS C User List; axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
Subject: Re: Client to receive large data problem
I fixed many guththila related issues after 1.6 release. Could you
check the trunk and see whether the problems are solved or still it is
there?
Regards,
Shankar
On Wed, Feb 24, 2010 at 9:04 PM, Hatim Daginawala
<Ha...@argodata.com> wrote:
> I have seen data truncation problem with libxml2 as well as guththila in
> 1.5 and 1.6. For me issue occurs when data size exceeds
> GUTHUTHILA_BUFFER_DEF_SIZE and it occurs sporadically. I have not found
> any recipe to recreate this and it happens only in our 'production like'
> environment.
>
> For some reason guththila stops reading data from transport layer buffer
> even when message is not read completely. The work around I am using is
> increasing the size of buffer on read to be the max data I am expecting
> (2MB). This transfers entire message from transport layer buffer to
> guththila buffer in just one read.
> I hate to allocate 2MB for every read (I have different sizes for reads
> and writes) since 95% of my messages are less than 16K.
>
> I would be glad to help resolve this issue. If there is a fix I will be
> happy to put it in our 'production like' environment and test it. We can
> recreate this issue a few times a day in this environment.
>
> -----Original Message-----
> From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
> Sent: Wednesday, February 24, 2010 12:28 AM
> To: Apache AXIS C User List
> Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
> Subject: Re: Client to receive large data problem
>
> Hi,
>
> What version of Axis2/C you are using? Are you using libxml2 or
> guththila?
>
> Can you verify whether it is a network related issue? You can capture
> the message and see whether server sends all the messages, and the
> problem is in client side.
>
> Regards,
> Shankar
>
> On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com>
> wrote:
>> Hi,
>>
>> Does anyone have experience in develop an application using AXIS2C
> client
>> API to consume a web services which returns large amount of data
> (about 2M).
>>
>>
>>
>> When my client application receives such large data, the data will be
>> truncated. This problem will get better (but not completely resolved)
> if I
>> add 3 seconds sleep time in axis2_http_client_recieve_header()
> function in
>> the http_client.c. I am hoping by doing so, my application can receive
> all
>> the data before start to process the data. But this does not resolve
> the
>> problem completely, I am wondering if there is any other solution.
>>
>>
>>
>> Thanks,
>>
>> Jan-fon
>>
>>
>
>
>
> --
> S.Uthaiyashankar
> Software Architect
> WSO2 Inc.
> http://wso2.com/ - "lean . enterprise . middleware"
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
> For additional commands, e-mail: c-user-help@axis.apache.org
>
>
>
> ---------------------------------------------------
> Confidentiality Notice: This electronic mail transmission is confidential,
> may be privileged and should be read or retained only by the intended
> recipient. If you have received this transmission in error, please
> immediately notify the sender and delete it from your system.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: c-dev-unsubscribe@axis.apache.org
> For additional commands, e-mail: c-dev-help@axis.apache.org
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
Re: Client to receive large data problem
Posted by Selvaratnam Uthaiyashankar <ut...@gmail.com>.
I fixed many guththila related issues after 1.6 release. Could you
check the trunk and see whether the problems are solved or still it is
there?
Regards,
Shankar
On Wed, Feb 24, 2010 at 9:04 PM, Hatim Daginawala
<Ha...@argodata.com> wrote:
> I have seen data truncation problem with libxml2 as well as guththila in
> 1.5 and 1.6. For me issue occurs when data size exceeds
> GUTHUTHILA_BUFFER_DEF_SIZE and it occurs sporadically. I have not found
> any recipe to recreate this and it happens only in our 'production like'
> environment.
>
> For some reason guththila stops reading data from transport layer buffer
> even when message is not read completely. The work around I am using is
> increasing the size of buffer on read to be the max data I am expecting
> (2MB). This transfers entire message from transport layer buffer to
> guththila buffer in just one read.
> I hate to allocate 2MB for every read (I have different sizes for reads
> and writes) since 95% of my messages are less than 16K.
>
> I would be glad to help resolve this issue. If there is a fix I will be
> happy to put it in our 'production like' environment and test it. We can
> recreate this issue a few times a day in this environment.
>
> -----Original Message-----
> From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
> Sent: Wednesday, February 24, 2010 12:28 AM
> To: Apache AXIS C User List
> Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
> Subject: Re: Client to receive large data problem
>
> Hi,
>
> What version of Axis2/C you are using? Are you using libxml2 or
> guththila?
>
> Can you verify whether it is a network related issue? You can capture
> the message and see whether server sends all the messages, and the
> problem is in client side.
>
> Regards,
> Shankar
>
> On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com>
> wrote:
>> Hi,
>>
>> Does anyone have experience in develop an application using AXIS2C
> client
>> API to consume a web services which returns large amount of data
> (about 2M).
>>
>>
>>
>> When my client application receives such large data, the data will be
>> truncated. This problem will get better (but not completely resolved)
> if I
>> add 3 seconds sleep time in axis2_http_client_recieve_header()
> function in
>> the http_client.c. I am hoping by doing so, my application can receive
> all
>> the data before start to process the data. But this does not resolve
> the
>> problem completely, I am wondering if there is any other solution.
>>
>>
>>
>> Thanks,
>>
>> Jan-fon
>>
>>
>
>
>
> --
> S.Uthaiyashankar
> Software Architect
> WSO2 Inc.
> http://wso2.com/ - "lean . enterprise . middleware"
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
> For additional commands, e-mail: c-user-help@axis.apache.org
>
>
>
> ---------------------------------------------------
> Confidentiality Notice: This electronic mail transmission is confidential,
> may be privileged and should be read or retained only by the intended
> recipient. If you have received this transmission in error, please
> immediately notify the sender and delete it from your system.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: c-dev-unsubscribe@axis.apache.org
> For additional commands, e-mail: c-dev-help@axis.apache.org
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
Re: Client to receive large data problem
Posted by Selvaratnam Uthaiyashankar <ut...@gmail.com>.
I fixed many guththila related issues after 1.6 release. Could you
check the trunk and see whether the problems are solved or still it is
there?
Regards,
Shankar
On Wed, Feb 24, 2010 at 9:04 PM, Hatim Daginawala
<Ha...@argodata.com> wrote:
> I have seen data truncation problem with libxml2 as well as guththila in
> 1.5 and 1.6. For me issue occurs when data size exceeds
> GUTHUTHILA_BUFFER_DEF_SIZE and it occurs sporadically. I have not found
> any recipe to recreate this and it happens only in our 'production like'
> environment.
>
> For some reason guththila stops reading data from transport layer buffer
> even when message is not read completely. The work around I am using is
> increasing the size of buffer on read to be the max data I am expecting
> (2MB). This transfers entire message from transport layer buffer to
> guththila buffer in just one read.
> I hate to allocate 2MB for every read (I have different sizes for reads
> and writes) since 95% of my messages are less than 16K.
>
> I would be glad to help resolve this issue. If there is a fix I will be
> happy to put it in our 'production like' environment and test it. We can
> recreate this issue a few times a day in this environment.
>
> -----Original Message-----
> From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
> Sent: Wednesday, February 24, 2010 12:28 AM
> To: Apache AXIS C User List
> Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
> Subject: Re: Client to receive large data problem
>
> Hi,
>
> What version of Axis2/C you are using? Are you using libxml2 or
> guththila?
>
> Can you verify whether it is a network related issue? You can capture
> the message and see whether server sends all the messages, and the
> problem is in client side.
>
> Regards,
> Shankar
>
> On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com>
> wrote:
>> Hi,
>>
>> Does anyone have experience in develop an application using AXIS2C
> client
>> API to consume a web services which returns large amount of data
> (about 2M).
>>
>>
>>
>> When my client application receives such large data, the data will be
>> truncated. This problem will get better (but not completely resolved)
> if I
>> add 3 seconds sleep time in axis2_http_client_recieve_header()
> function in
>> the http_client.c. I am hoping by doing so, my application can receive
> all
>> the data before start to process the data. But this does not resolve
> the
>> problem completely, I am wondering if there is any other solution.
>>
>>
>>
>> Thanks,
>>
>> Jan-fon
>>
>>
>
>
>
> --
> S.Uthaiyashankar
> Software Architect
> WSO2 Inc.
> http://wso2.com/ - "lean . enterprise . middleware"
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
> For additional commands, e-mail: c-user-help@axis.apache.org
>
>
>
> ---------------------------------------------------
> Confidentiality Notice: This electronic mail transmission is confidential,
> may be privileged and should be read or retained only by the intended
> recipient. If you have received this transmission in error, please
> immediately notify the sender and delete it from your system.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: c-dev-unsubscribe@axis.apache.org
> For additional commands, e-mail: c-dev-help@axis.apache.org
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-dev-unsubscribe@axis.apache.org
For additional commands, e-mail: c-dev-help@axis.apache.org
Re: Client to receive large data problem
Posted by Selvaratnam Uthaiyashankar <ut...@gmail.com>.
I fixed many guththila related issues after 1.6 release. Could you
check the trunk and see whether the problems are solved or still it is
there?
Regards,
Shankar
On Wed, Feb 24, 2010 at 9:04 PM, Hatim Daginawala
<Ha...@argodata.com> wrote:
> I have seen data truncation problem with libxml2 as well as guththila in
> 1.5 and 1.6. For me issue occurs when data size exceeds
> GUTHUTHILA_BUFFER_DEF_SIZE and it occurs sporadically. I have not found
> any recipe to recreate this and it happens only in our 'production like'
> environment.
>
> For some reason guththila stops reading data from transport layer buffer
> even when message is not read completely. The work around I am using is
> increasing the size of buffer on read to be the max data I am expecting
> (2MB). This transfers entire message from transport layer buffer to
> guththila buffer in just one read.
> I hate to allocate 2MB for every read (I have different sizes for reads
> and writes) since 95% of my messages are less than 16K.
>
> I would be glad to help resolve this issue. If there is a fix I will be
> happy to put it in our 'production like' environment and test it. We can
> recreate this issue a few times a day in this environment.
>
> -----Original Message-----
> From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
> Sent: Wednesday, February 24, 2010 12:28 AM
> To: Apache AXIS C User List
> Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
> Subject: Re: Client to receive large data problem
>
> Hi,
>
> What version of Axis2/C you are using? Are you using libxml2 or
> guththila?
>
> Can you verify whether it is a network related issue? You can capture
> the message and see whether server sends all the messages, and the
> problem is in client side.
>
> Regards,
> Shankar
>
> On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com>
> wrote:
>> Hi,
>>
>> Does anyone have experience in develop an application using AXIS2C
> client
>> API to consume a web services which returns large amount of data
> (about 2M).
>>
>>
>>
>> When my client application receives such large data, the data will be
>> truncated. This problem will get better (but not completely resolved)
> if I
>> add 3 seconds sleep time in axis2_http_client_recieve_header()
> function in
>> the http_client.c. I am hoping by doing so, my application can receive
> all
>> the data before start to process the data. But this does not resolve
> the
>> problem completely, I am wondering if there is any other solution.
>>
>>
>>
>> Thanks,
>>
>> Jan-fon
>>
>>
>
>
>
> --
> S.Uthaiyashankar
> Software Architect
> WSO2 Inc.
> http://wso2.com/ - "lean . enterprise . middleware"
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
> For additional commands, e-mail: c-user-help@axis.apache.org
>
>
>
> ---------------------------------------------------
> Confidentiality Notice: This electronic mail transmission is confidential,
> may be privileged and should be read or retained only by the intended
> recipient. If you have received this transmission in error, please
> immediately notify the sender and delete it from your system.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: c-dev-unsubscribe@axis.apache.org
> For additional commands, e-mail: c-dev-help@axis.apache.org
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-dev-unsubscribe@axis.apache.org
For additional commands, e-mail: c-dev-help@axis.apache.org
RE: Client to receive large data problem
Posted by "Fan, Jan-fon" <ja...@intel.com>.
Hi Daginawala,
Thank you so much for telling me this work around.
I tried to increase GUTHTHILA_BUFFER_DEF_SIZE from 16384 to 2000000, but unfortunately the data still got truncated.
Is there other buffer size that I need to increase?
Thanks,
Jan-fon
-----Original Message-----
From: Hatim Daginawala [mailto:Hatim.Daginawala@argodata.com]
Sent: Wednesday, February 24, 2010 7:34 AM
To: Apache AXIS C User List
Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
Subject: RE: Client to receive large data problem
I have seen data truncation problem with libxml2 as well as guththila in
1.5 and 1.6. For me issue occurs when data size exceeds
GUTHUTHILA_BUFFER_DEF_SIZE and it occurs sporadically. I have not found
any recipe to recreate this and it happens only in our 'production like'
environment.
For some reason guththila stops reading data from transport layer buffer
even when message is not read completely. The work around I am using is
increasing the size of buffer on read to be the max data I am expecting
(2MB). This transfers entire message from transport layer buffer to
guththila buffer in just one read.
I hate to allocate 2MB for every read (I have different sizes for reads
and writes) since 95% of my messages are less than 16K.
I would be glad to help resolve this issue. If there is a fix I will be
happy to put it in our 'production like' environment and test it. We can
recreate this issue a few times a day in this environment.
-----Original Message-----
From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
Sent: Wednesday, February 24, 2010 12:28 AM
To: Apache AXIS C User List
Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
Subject: Re: Client to receive large data problem
Hi,
What version of Axis2/C you are using? Are you using libxml2 or
guththila?
Can you verify whether it is a network related issue? You can capture
the message and see whether server sends all the messages, and the
problem is in client side.
Regards,
Shankar
On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com>
wrote:
> Hi,
>
> Does anyone have experience in develop an application using AXIS2C
client
> API to consume a web services which returns large amount of data
(about 2M).
>
>
>
> When my client application receives such large data, the data will be
> truncated. This problem will get better (but not completely resolved)
if I
> add 3 seconds sleep time in axis2_http_client_recieve_header()
function in
> the http_client.c. I am hoping by doing so, my application can receive
all
> the data before start to process the data. But this does not resolve
the
> problem completely, I am wondering if there is any other solution.
>
>
>
> Thanks,
>
> Jan-fon
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
---------------------------------------------------
Confidentiality Notice: This electronic mail transmission is confidential,
may be privileged and should be read or retained only by the intended
recipient. If you have received this transmission in error, please
immediately notify the sender and delete it from your system.
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
RE: Client to receive large data problem
Posted by Hatim Daginawala <Ha...@argodata.com>.
I have seen data truncation problem with libxml2 as well as guththila in
1.5 and 1.6. For me issue occurs when data size exceeds
GUTHUTHILA_BUFFER_DEF_SIZE and it occurs sporadically. I have not found
any recipe to recreate this and it happens only in our 'production like'
environment.
For some reason guththila stops reading data from transport layer buffer
even when message is not read completely. The work around I am using is
increasing the size of buffer on read to be the max data I am expecting
(2MB). This transfers entire message from transport layer buffer to
guththila buffer in just one read.
I hate to allocate 2MB for every read (I have different sizes for reads
and writes) since 95% of my messages are less than 16K.
I would be glad to help resolve this issue. If there is a fix I will be
happy to put it in our 'production like' environment and test it. We can
recreate this issue a few times a day in this environment.
-----Original Message-----
From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
Sent: Wednesday, February 24, 2010 12:28 AM
To: Apache AXIS C User List
Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
Subject: Re: Client to receive large data problem
Hi,
What version of Axis2/C you are using? Are you using libxml2 or
guththila?
Can you verify whether it is a network related issue? You can capture
the message and see whether server sends all the messages, and the
problem is in client side.
Regards,
Shankar
On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com>
wrote:
> Hi,
>
> Does anyone have experience in develop an application using AXIS2C
client
> API to consume a web services which returns large amount of data
(about 2M).
>
>
>
> When my client application receives such large data, the data will be
> truncated. This problem will get better (but not completely resolved)
if I
> add 3 seconds sleep time in axis2_http_client_recieve_header()
function in
> the http_client.c. I am hoping by doing so, my application can receive
all
> the data before start to process the data. But this does not resolve
the
> problem completely, I am wondering if there is any other solution.
>
>
>
> Thanks,
>
> Jan-fon
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
---------------------------------------------------
Confidentiality Notice: This electronic mail transmission is confidential,
may be privileged and should be read or retained only by the intended
recipient. If you have received this transmission in error, please
immediately notify the sender and delete it from your system.
---------------------------------------------------------------------
To unsubscribe, e-mail: c-dev-unsubscribe@axis.apache.org
For additional commands, e-mail: c-dev-help@axis.apache.org
RE: Client to receive large data problem
Posted by "Fan, Jan-fon" <ja...@intel.com>.
Hi Shankar,
I am using AXIS2/C 1.6 release.
I only specified "--prefix" option for the configure command when building AXIS2C, the others are default values. I guess the default for --enable-guththila is yes and --enable-libxml2 is no.
However, before I build AXIS2C, I set the PKG_CONFIG_PATH environment variable to where the pkgconfig of the libxml resides. So I am not sure if I am using libxml2 or guththila.
I used a firewall tool to capture the traffic from server and I did see server sends all the data. So I believe it is the problem in the client side.
Thanks,
Jan-fon
-----Original Message-----
From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
Sent: Tuesday, February 23, 2010 10:28 PM
To: Apache AXIS C User List
Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
Subject: Re: Client to receive large data problem
Hi,
What version of Axis2/C you are using? Are you using libxml2 or guththila?
Can you verify whether it is a network related issue? You can capture
the message and see whether server sends all the messages, and the
problem is in client side.
Regards,
Shankar
On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com> wrote:
> Hi,
>
> Does anyone have experience in develop an application using AXIS2C client
> API to consume a web services which returns large amount of data (about 2M).
>
>
>
> When my client application receives such large data, the data will be
> truncated. This problem will get better (but not completely resolved) if I
> add 3 seconds sleep time in axis2_http_client_recieve_header() function in
> the http_client.c. I am hoping by doing so, my application can receive all
> the data before start to process the data. But this does not resolve the
> problem completely, I am wondering if there is any other solution.
>
>
>
> Thanks,
>
> Jan-fon
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
RE: Client to receive large data problem
Posted by Hatim Daginawala <Ha...@argodata.com>.
I have seen data truncation problem with libxml2 as well as guththila in
1.5 and 1.6. For me issue occurs when data size exceeds
GUTHUTHILA_BUFFER_DEF_SIZE and it occurs sporadically. I have not found
any recipe to recreate this and it happens only in our 'production like'
environment.
For some reason guththila stops reading data from transport layer buffer
even when message is not read completely. The work around I am using is
increasing the size of buffer on read to be the max data I am expecting
(2MB). This transfers entire message from transport layer buffer to
guththila buffer in just one read.
I hate to allocate 2MB for every read (I have different sizes for reads
and writes) since 95% of my messages are less than 16K.
I would be glad to help resolve this issue. If there is a fix I will be
happy to put it in our 'production like' environment and test it. We can
recreate this issue a few times a day in this environment.
-----Original Message-----
From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
Sent: Wednesday, February 24, 2010 12:28 AM
To: Apache AXIS C User List
Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
Subject: Re: Client to receive large data problem
Hi,
What version of Axis2/C you are using? Are you using libxml2 or
guththila?
Can you verify whether it is a network related issue? You can capture
the message and see whether server sends all the messages, and the
problem is in client side.
Regards,
Shankar
On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com>
wrote:
> Hi,
>
> Does anyone have experience in develop an application using AXIS2C
client
> API to consume a web services which returns large amount of data
(about 2M).
>
>
>
> When my client application receives such large data, the data will be
> truncated. This problem will get better (but not completely resolved)
if I
> add 3 seconds sleep time in axis2_http_client_recieve_header()
function in
> the http_client.c. I am hoping by doing so, my application can receive
all
> the data before start to process the data. But this does not resolve
the
> problem completely, I am wondering if there is any other solution.
>
>
>
> Thanks,
>
> Jan-fon
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
---------------------------------------------------
Confidentiality Notice: This electronic mail transmission is confidential,
may be privileged and should be read or retained only by the intended
recipient. If you have received this transmission in error, please
immediately notify the sender and delete it from your system.
---------------------------------------------------------------------
To unsubscribe, e-mail: c-dev-unsubscribe@axis.apache.org
For additional commands, e-mail: c-dev-help@axis.apache.org
RE: Client to receive large data problem
Posted by Hatim Daginawala <Ha...@argodata.com>.
I have seen data truncation problem with libxml2 as well as guththila in
1.5 and 1.6. For me issue occurs when data size exceeds
GUTHUTHILA_BUFFER_DEF_SIZE and it occurs sporadically. I have not found
any recipe to recreate this and it happens only in our 'production like'
environment.
For some reason guththila stops reading data from transport layer buffer
even when message is not read completely. The work around I am using is
increasing the size of buffer on read to be the max data I am expecting
(2MB). This transfers entire message from transport layer buffer to
guththila buffer in just one read.
I hate to allocate 2MB for every read (I have different sizes for reads
and writes) since 95% of my messages are less than 16K.
I would be glad to help resolve this issue. If there is a fix I will be
happy to put it in our 'production like' environment and test it. We can
recreate this issue a few times a day in this environment.
-----Original Message-----
From: Selvaratnam Uthaiyashankar [mailto:uthaiyashankar@gmail.com]
Sent: Wednesday, February 24, 2010 12:28 AM
To: Apache AXIS C User List
Cc: axis-c-dev@ws.apache.org; axis-c-user@ws.apache.org
Subject: Re: Client to receive large data problem
Hi,
What version of Axis2/C you are using? Are you using libxml2 or
guththila?
Can you verify whether it is a network related issue? You can capture
the message and see whether server sends all the messages, and the
problem is in client side.
Regards,
Shankar
On Wed, Feb 24, 2010 at 11:32 AM, Fan, Jan-fon <ja...@intel.com>
wrote:
> Hi,
>
> Does anyone have experience in develop an application using AXIS2C
client
> API to consume a web services which returns large amount of data
(about 2M).
>
>
>
> When my client application receives such large data, the data will be
> truncated. This problem will get better (but not completely resolved)
if I
> add 3 seconds sleep time in axis2_http_client_recieve_header()
function in
> the http_client.c. I am hoping by doing so, my application can receive
all
> the data before start to process the data. But this does not resolve
the
> problem completely, I am wondering if there is any other solution.
>
>
>
> Thanks,
>
> Jan-fon
>
>
--
S.Uthaiyashankar
Software Architect
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org
---------------------------------------------------
Confidentiality Notice: This electronic mail transmission is confidential,
may be privileged and should be read or retained only by the intended
recipient. If you have received this transmission in error, please
immediately notify the sender and delete it from your system.
---------------------------------------------------------------------
To unsubscribe, e-mail: c-user-unsubscribe@axis.apache.org
For additional commands, e-mail: c-user-help@axis.apache.org