You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Sebastian Nagel (Jira)" <ji...@apache.org> on 2021/09/20 13:02:00 UTC
[jira] [Updated] (NUTCH-2890) Protocol-okhttp: upgrade okhttp to
4.9.1 to address infinite connection retries
[ https://issues.apache.org/jira/browse/NUTCH-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sebastian Nagel updated NUTCH-2890:
-----------------------------------
Summary: Protocol-okhttp: upgrade okhttp to 4.9.1 to address infinite connection retries (was: Protocok-okhttp: upgrade okhttp to 4.9.1 to address infinite connection retries)
> Protocol-okhttp: upgrade okhttp to 4.9.1 to address infinite connection retries
> -------------------------------------------------------------------------------
>
> Key: NUTCH-2890
> URL: https://issues.apache.org/jira/browse/NUTCH-2890
> Project: Nutch
> Issue Type: Bug
> Components: plugin, protocol
> Affects Versions: 1.18
> Reporter: Sebastian Nagel
> Assignee: Sebastian Nagel
> Priority: Major
> Fix For: 1.19
>
> Attachments: fetcher-protocol-okhttp-NUTCH-2890-async-profiler.png
>
>
> In rare situations and under heavy load (> 100 fetcher threads) I've seen that the protocol-okhttp plugin gets into a state where a significant amount of CPU time is spent in handling failed connections, see [async-profiler|https://github.com/jvm-profiling-tools/async-profiler] screenshot. This is caused by [okhttp#5819|https://github.com/square/okhttp/issues/5819] which is fixed with okhttp [4.5.0|https://square.github.io/okhttp/changelog/#version-450]).
> We should upgrade to the okhttp 4.9.1 (the current stable version).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)