You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hc.apache.org by mcp219 <mc...@tid.es> on 2003/04/21 20:16:12 UTC
Maximum Response Body Size?
Hello!
I'm working in a kind of proxy/html_parser using HttpClient since
nigthly build 13/03/2003.
Nowadays I'm using nigthly build 14/04/2003, with jdk 1.4.1_02 and
tomcat 4.1.18, W2K
I have a problem, the responseBody of a GetMethod using https closes
unexpectedly at 16386 byte.
The size of the whole page (using ie) is 51559.
Is there any limitation in the size of the responseBody?,.
What I'm doing wrong?...
I also have a WARN with a cookie...
WARN HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
Invalid cookie header:
"NSES40Session=f%253A3ea4179b%253Ab3ac5c11c1ced31;path=/;expires=Mon,
21-Apr-2003 16:38:59 GMT". Unable to parse expiration date parameter:
Mon
BTW, is there any stress analisys of httpClient?
Am I so imaginative thinking about 3 million hits a day (working time)
using httpClient?. (intranet application)
Thanks in advance,
Manuel Castro
.....
TRACE LOG...
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpState -
enter HttpState.setCredentials(String realm, String host, Credentials
credentials)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.setQueryString(NameValuePair[])
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
HttpMethodBase.addRequestHeader(Header)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpClient -
enter HttpClient.executeMethod(HttpMethod)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpClient -
enter HttpClient.executeMethod(HostConfiguration,HttpMethod)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - Creating connection for
10.15.193.59 using protocol https:443
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection -
HttpConnection.setSoTimeout(0)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.open()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.execute(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
Preemptively sending default basic credentials
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.auth.HttpAuthenticator - enter
HttpAuthenticator.authenticateDefault(HttpMethod, HttpConnection,
HttpState)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpState -
enter HttpState.getCredentials(String, String
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
Execute loop try 1
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.processRequest(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
Attempt number 1 to write request
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.writeRequest(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.writeRequestLine(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.generateRequestLine(HttpConnection, String, String,
String, String)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "GET
/t7/v890/servlet/t7frabjg? HTTP/1.0[\r][\n]"
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.print(String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.writeRequestHeaders(HttpState,HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.addRequestHeaders(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.addUserAgentRequestHeaders(HttpState,
HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.addHostRequestHeader(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
Adding Host request header
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.addCookieRequestHeader(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpState -
enter HttpState.getCookies()
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.cookie.CookieSpec - enter
CookieSpecBase.match(String, int, String, boolean, Cookie[])
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.addAuthorizationRequestHeader(HttpState,
HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.addProxyAuthorizationRequestHeader(HttpState,
HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.addContentLengthRequestHeader(HttpState,
HttpConnection)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "accept: image/gif,
image/x-xbitmap, image/jpeg, image/pjpeg, application/x-shockwave-flash,
application/vnd.ms-excel, application/vnd.ms-powerpoint,
application/msword, */*[\r][\n]"
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.print(String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "referer:
http://localhost:8080/aprm/contenido5.htm[\r][\n]"
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.print(String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "accept-language:
es[\r][\n]"
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.print(String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "accept-encoding:
gzip, deflate[\r][\n]"
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.print(String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "user-agent:
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)[\r][\n]"
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.print(String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "connection:
Keep-Alive[\r][\n]"
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.print(String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "Authorization: Basic
RzB4Mnpnd76Tp0N2FkbWluMQ==[\r][\n]"
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.print(String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "Host:
10.15.193.59:8999[\r][\n]"
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.print(String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.writeLine()
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[])
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.write(byte[], int, int)
DEBUG HttpProcessor[8080][4] httpclient.wire - >> "[\r][\n]"
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.readResponse(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.readStatusLine(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.readLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readRawLine()
DEBUG HttpProcessor[8080][4] httpclient.wire - << "HTTP/1.1 200
OK[\r][\n]"
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.readResponseHeaders(HttpState,HttpConnection)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.getResponseInputStream()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HeaderParser.parseHeaders(HttpConnection, HeaderGroup)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readRawLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readRawLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readRawLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readRawLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readRawLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readLine()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpParser -
enter HttpParser.readRawLine()
DEBUG HttpProcessor[8080][4] httpclient.wire - << "Server:
Netscape-Enterprise/4.1[\r][\n]"
DEBUG HttpProcessor[8080][4] httpclient.wire - << "Date: Mon, 21 Apr
2003 16:08:59 GMT[\r][\n]"
DEBUG HttpProcessor[8080][4] httpclient.wire - << "Content-type:
text/html[\r][\n]"
DEBUG HttpProcessor[8080][4] httpclient.wire - << "Set-cookie:
NSES40Session=f%253A3ea4179b%253Ab3ac5c11c1ced31;path=/;expires=Mon,
21-Apr-2003 16:38:59 GMT[\r][\n]"
DEBUG HttpProcessor[8080][4] httpclient.wire - << "Connection:
close[\r][\n]"
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.processResponseHeaders(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.cookie.CookieSpec - enter
CookieSpecBase.parse(String, port, path, boolean, String)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.cookie.CookieSpec - enter
CookieSpecBase.parse(String, port, path, boolean, Header)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HeaderElement
- enter HeaderElement.parse(String)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HeaderElement
- enter HeaderElement.parsePair(char[], int, int)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HeaderElement
- enter HeaderElement.parsePair(char[], int, int)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HeaderElement
- enter HeaderElement.parsePair(char[], int, int)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HeaderElement
- enter HeaderElement.parsePair(char[], int, int)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.Cookie -
enter Cookie(String, String, String, String, Date, boolean)
WARN HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
Invalid cookie header:
"NSES40Session=f%253A3ea4179b%253Ab3ac5c11c1ced31;path=/;expires=Mon,
21-Apr-2003 16:38:59 GMT". Unable to parse expiration date parameter:
Mon
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.methods.GetMethod - enter
GetMethod.readResponseBody(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.readResponseBody(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.readResponseBody(HttpState, HttpConnection)
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.getResponseInputStream()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.canResponseHaveBody(int)
DEBUG HttpProcessor[8080][4]
es.tid.prm.lf.retievers.HTTPContentRetriever - --->REQUEST SENT
Result:200
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpState -
enter HttpState.getCookies()
DEBUG HttpProcessor[8080][4]
es.tid.prm.lf.retievers.HTTPContentRetriever - Authorization Header
Found
DEBUG HttpProcessor[8080][4]
es.tid.prm.lf.retievers.HTTPContentRetriever - <--- RESPONSE RECEIVED
Successfully
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.methods.GetMethod - enter
GetMethod.getResponseBody()
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.methods.GetMethod - enter
GetMethod.getResponseBodyAsStream()
DEBUG HttpProcessor[8080][4] httpclient.wire - << "<!DOCTYPE HTML PUBLIC
"-//W3C//DTD HTML 3.2 Final//EN">[\r][\n]"
DEBUG HttpProcessor[8080][4] httpclient.wire - << "<HTML>[\r][\n]"
DEBUG HttpProcessor[8080][4] httpclient.wire - << "<HEAD>[\r][\n]"
...
..
DEBUG HttpProcessor[8080][4] httpclient.wire - << "[0x9][0x9]var l =
eval(this.container).location.pathname + '#joustEntry' +
entryNo;[\r][\n]"
DEBUG HttpProcessor[8080][4] httpclient.wire - <<
"[0x9][0x9]setTimeout(this.cont"
-------------------------------------!!!! WHY STOPS
HERE???!!!!!------------------------------------
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
Should close connection since "Connection: close" header found.
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.close()
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.closeSockedAndStreams()
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.HttpConnection - enter
HttpConnection.releaseConnection()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
buffering response body
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter getContentCharSet( Header contentheader )
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HeaderElement
- enter HeaderElement.parse(String)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HeaderElement
- enter HeaderElement.parsePair(char[], int, int)
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
Default charset used: ISO-8859-1
DEBUG HttpProcessor[8080][4]
es.tid.prm.lf.retievers.HTTPContentRetriever - <!DOCTYPE HTML PUBLIC
"-//W3C//DTD HTML 3.2 Final//EN">
<HTML>
<HEAD>
....
DEBUG HttpProcessor[8080][4]
org.apache.commons.httpclient.methods.GetMethod - enter
GetMethod.recycle()
DEBUG HttpProcessor[8080][4] org.apache.commons.httpclient.HttpMethod -
enter HttpMethodBase.recycle()
...