You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hc.apache.org by "Manoj (JIRA)" <ji...@apache.org> on 2007/12/22 20:16:43 UTC
[jira] Created: (HTTPCLIENT-724) HttpClient much slower than
browser
HttpClient much slower than browser
-----------------------------------
Key: HTTPCLIENT-724
URL: https://issues.apache.org/jira/browse/HTTPCLIENT-724
Project: HttpComponents HttpClient
Issue Type: Improvement
Components: HttpClient
Affects Versions: 3.1 Final
Environment: XP
Reporter: Manoj
This is continuation of my post in the mailing list "Performance Issues with Transfer-Encoding chunked".
Three files are uploaded here:
a) Wirelog
b) WireShark log of downloading with HttpClient
c) WireShark log of downloading with IE
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org
[jira] Updated: (HTTPCLIENT-724) HttpClient much slower than
browser
Posted by "Roland Weber (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HTTPCLIENT-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Roland Weber updated HTTPCLIENT-724:
------------------------------------
Fix Version/s: (was: 4.0 Beta 1)
> HttpClient much slower than browser
> -----------------------------------
>
> Key: HTTPCLIENT-724
> URL: https://issues.apache.org/jira/browse/HTTPCLIENT-724
> Project: HttpComponents HttpClient
> Issue Type: Improvement
> Components: HttpClient
> Affects Versions: 3.1 Final
> Environment: XP
> Reporter: Manoj
> Attachments: HttpClient 4.0 Reuters.pcap
>
>
> This is continuation of my post in the mailing list "Performance Issues with Transfer-Encoding chunked".
> Three files are uploaded here:
> a) Wirelog
> b) WireShark log of downloading with HttpClient
> c) WireShark log of downloading with IE
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org
[jira] Commented: (HTTPCLIENT-724) HttpClient much slower than
browser
Posted by "Manoj (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HTTPCLIENT-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556622#action_12556622 ]
Manoj commented on HTTPCLIENT-724:
----------------------------------
Can these changes be applied to 3.1. If you give me the higlevel changes done to 4.0, I could prot it to 3.1.
> HttpClient much slower than browser
> -----------------------------------
>
> Key: HTTPCLIENT-724
> URL: https://issues.apache.org/jira/browse/HTTPCLIENT-724
> Project: HttpComponents HttpClient
> Issue Type: Improvement
> Components: HttpClient
> Affects Versions: 3.1 Final
> Environment: XP
> Reporter: Manoj
> Attachments: HttpClient 4.0 Reuters.pcap
>
>
> This is continuation of my post in the mailing list "Performance Issues with Transfer-Encoding chunked".
> Three files are uploaded here:
> a) Wirelog
> b) WireShark log of downloading with HttpClient
> c) WireShark log of downloading with IE
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org
[jira] Commented: (HTTPCLIENT-724) HttpClient much slower than
browser
Posted by "Oleg Kalnichevski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HTTPCLIENT-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556715#action_12556715 ]
Oleg Kalnichevski commented on HTTPCLIENT-724:
----------------------------------------------
Manoj,
(1) HttpClient 4.0 is a complete rewrite of the old codeline. It has a completely different set of core components. These changes cannot be back-ported to 3.1
(2) HttpClient 4.0 is approximately 30% faster for small and medium entities. The difference in performance is less than 10% for larger entities.
http://wiki.apache.org/jakarta-httpclient/HttpClient3vsHttpClient4vsHttpCore
As I said before the problem you are having has NOTHING to do with HttpClient
Oleg
> HttpClient much slower than browser
> -----------------------------------
>
> Key: HTTPCLIENT-724
> URL: https://issues.apache.org/jira/browse/HTTPCLIENT-724
> Project: HttpComponents HttpClient
> Issue Type: Improvement
> Components: HttpClient
> Affects Versions: 3.1 Final
> Environment: XP
> Reporter: Manoj
> Attachments: HttpClient 4.0 Reuters.pcap
>
>
> This is continuation of my post in the mailing list "Performance Issues with Transfer-Encoding chunked".
> Three files are uploaded here:
> a) Wirelog
> b) WireShark log of downloading with HttpClient
> c) WireShark log of downloading with IE
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org
[jira] Commented: (HTTPCLIENT-724) HttpClient much slower than
browser
Posted by "Oleg Kalnichevski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HTTPCLIENT-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554344 ]
Oleg Kalnichevski commented on HTTPCLIENT-724:
----------------------------------------------
Manoj,
(1) I see no valid HTTP response to the initial GET request in the wire log, just garbage and lots of retransmissions. The whole thing is just meaningless.
(2) Where's the corresponding IE wire log?
(3) you can activate the wire log by setting DEBUG priority on the org.apache.http.wire logger
Oleg
> HttpClient much slower than browser
> -----------------------------------
>
> Key: HTTPCLIENT-724
> URL: https://issues.apache.org/jira/browse/HTTPCLIENT-724
> Project: HttpComponents HttpClient
> Issue Type: Improvement
> Components: HttpClient
> Affects Versions: 3.1 Final
> Environment: XP
> Reporter: Manoj
> Fix For: 4.0 Beta 1
>
> Attachments: HttpClient 4.0 Reuters.pcap
>
>
> This is continuation of my post in the mailing list "Performance Issues with Transfer-Encoding chunked".
> Three files are uploaded here:
> a) Wirelog
> b) WireShark log of downloading with HttpClient
> c) WireShark log of downloading with IE
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org
[jira] Updated: (HTTPCLIENT-724) HttpClient much slower than
browser
Posted by "Manoj (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HTTPCLIENT-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Manoj updated HTTPCLIENT-724:
-----------------------------
Attachment: HttpClient 4.0 Reuters.pcap
Oleg,
Attaching HttpClient 4.0 Wireshark output.
BTW: How do I get the wire log from HttpClient 4.0?
> HttpClient much slower than browser
> -----------------------------------
>
> Key: HTTPCLIENT-724
> URL: https://issues.apache.org/jira/browse/HTTPCLIENT-724
> Project: HttpComponents HttpClient
> Issue Type: Improvement
> Components: HttpClient
> Affects Versions: 3.1 Final
> Environment: XP
> Reporter: Manoj
> Fix For: 4.0 Beta 1
>
> Attachments: HttpClient 4.0 Reuters.pcap
>
>
> This is continuation of my post in the mailing list "Performance Issues with Transfer-Encoding chunked".
> Three files are uploaded here:
> a) Wirelog
> b) WireShark log of downloading with HttpClient
> c) WireShark log of downloading with IE
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org
[jira] Resolved: (HTTPCLIENT-724) HttpClient much slower than
browser
Posted by "Oleg Kalnichevski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HTTPCLIENT-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Oleg Kalnichevski resolved HTTPCLIENT-724.
------------------------------------------
Resolution: Invalid
On my cable line I get the document in less then a second WITH logging on. The server sends the content delimited with Content-Length, not chunked, though. I have no idea how to force it to use chunk coding. As I said before performance tests against a very busy remote site are just meaningless.
===
HttpParams params = new BasicHttpParams();
HttpProtocolParams.setVersion(params, HttpVersion.HTTP_1_1);
HttpProtocolParams.setContentCharset(params, "UTF-8");
HttpProtocolParams.setUserAgent(params, "Apache-HttpClient/4.0");
HttpConnectionParams.setStaleCheckingEnabled(params, true);
DefaultHttpClient httpclient = new DefaultHttpClient(params);
HttpGet httpget = new HttpGet("http://www.reuters.com/article/bankingfinancial-SP/idUSN2432828320070824");
long start = System.currentTimeMillis();
HttpResponse response = httpclient.execute(httpget);
HttpEntity entity = response.getEntity();
if (entity != null) {
entity.consumeContent();
}
long finish = System.currentTimeMillis();
System.out.println(finish - start + " ms");
===
[DEBUG] headers - >> GET /article/bankingfinancial-SP/idUSN2432828320070824 HTTP/1.1
[DEBUG] headers - >> Host: www.reuters.com
[DEBUG] headers - >> Connection: Keep-Alive
[DEBUG] headers - >> User-Agent: Apache-HttpClient/4.0
[DEBUG] headers - << HTTP/1.1 200 OK
[DEBUG] headers - << Date: Tue, 25 Dec 2007 15:24:17 GMT
[DEBUG] headers - << Server: Apache
[DEBUG] headers - << Age: 106
[DEBUG] headers - << Content-Length: 75933
[DEBUG] headers - << Keep-Alive: timeout=2, max=100
[DEBUG] headers - << Connection: Keep-Alive
[DEBUG] headers - << Content-Type: text/html;charset=ISO-8859-1
959 ms
===
Feel free to re-open the issue if you can provide more substantial data backing your assertion.
Oleg
> HttpClient much slower than browser
> -----------------------------------
>
> Key: HTTPCLIENT-724
> URL: https://issues.apache.org/jira/browse/HTTPCLIENT-724
> Project: HttpComponents HttpClient
> Issue Type: Improvement
> Components: HttpClient
> Affects Versions: 3.1 Final
> Environment: XP
> Reporter: Manoj
> Fix For: 4.0 Beta 1
>
> Attachments: HttpClient 4.0 Reuters.pcap
>
>
> This is continuation of my post in the mailing list "Performance Issues with Transfer-Encoding chunked".
> Three files are uploaded here:
> a) Wirelog
> b) WireShark log of downloading with HttpClient
> c) WireShark log of downloading with IE
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org
[jira] Updated: (HTTPCLIENT-724) HttpClient much slower than
browser
Posted by "Oleg Kalnichevski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HTTPCLIENT-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Oleg Kalnichevski updated HTTPCLIENT-724:
-----------------------------------------
Fix Version/s: 4.0 Beta 1
It is pointless to spend time and efforts optimizing the code line which is nearing its end of life. Please produce a WireShark log of the same session with HttpClient 4.0 and I'll look into this issue.
Oleg
> HttpClient much slower than browser
> -----------------------------------
>
> Key: HTTPCLIENT-724
> URL: https://issues.apache.org/jira/browse/HTTPCLIENT-724
> Project: HttpComponents HttpClient
> Issue Type: Improvement
> Components: HttpClient
> Affects Versions: 3.1 Final
> Environment: XP
> Reporter: Manoj
> Fix For: 4.0 Beta 1
>
>
> This is continuation of my post in the mailing list "Performance Issues with Transfer-Encoding chunked".
> Three files are uploaded here:
> a) Wirelog
> b) WireShark log of downloading with HttpClient
> c) WireShark log of downloading with IE
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@hc.apache.org
For additional commands, e-mail: dev-help@hc.apache.org