You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Markus Jelsma (Jira)" <ji...@apache.org> on 2025/02/12 11:46:00 UTC
[jira] [Updated] (NUTCH-3107) QueryString normalizer to support per-host removal of qstr params
[ https://issues.apache.org/jira/browse/NUTCH-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Jelsma updated NUTCH-3107:
---------------------------------
Attachment: NUTCH-3107.patch
> QueryString normalizer to support per-host removal of qstr params
> -----------------------------------------------------------------
>
> Key: NUTCH-3107
> URL: https://issues.apache.org/jira/browse/NUTCH-3107
> Project: Nutch
> Issue Type: Improvement
> Components: urlnormalizer
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Priority: Minor
> Fix For: 1.21
>
> Attachments: NUTCH-3107.patch
>
>
> QueryString Normalizer now only does sorting of query string key/value pairs. It could also support removal of per-host configurable keys.
> Normally this can be done in normalizer regex, but having a few million XML entries in the config parsed everytime, and millions of regular expressions executed is not very convenient.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)