You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Sebastian Nagel (Jira)" <ji...@apache.org> on 2019/11/22 15:19:00 UTC

[jira] [Updated] (NUTCH-2134) Redirection and cookie handling using protocol plugins

     [ https://issues.apache.org/jira/browse/NUTCH-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Nagel updated NUTCH-2134:
-----------------------------------
    Fix Version/s: 1.17

> Redirection and cookie handling using protocol  plugins
> -------------------------------------------------------
>
>                 Key: NUTCH-2134
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2134
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher, plugin, protocol
>    Affects Versions: 1.11
>            Reporter: Yogendra Kumar Soni
>            Priority: Minor
>             Fix For: 1.17
>
>
> fetcher thread is handling redirection logic and it is failing where redirection 301 takes to some other domain and get authentication cookies from there and again redirects to same url with cookies (even if domain is in urlfilter). HttpClient 4.5 uses automatic redirection handling with cookies, which is working well. In place of handling redirects in fetcherThread we can enable user to use HTTPclients 4.5 redirection handling. In other words  enable redirection handling logic selection using HttpBase or protocol plugin.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)