You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tika.apache.org by "Hudson (Jira)" <ji...@apache.org> on 2021/09/02 20:18:00 UTC

[jira] [Commented] (TIKA-3543) Various improvements to http fetcher

    [ https://issues.apache.org/jira/browse/TIKA-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409104#comment-17409104 ] 

Hudson commented on TIKA-3543:
------------------------------

SUCCESS: Integrated in Jenkins build Tika » tika-main-jdk8 #325 (See [https://ci-builds.apache.org/job/Tika/job/tika-main-jdk8/325/])
TIKA-3543 -- improve robustness and feature set of HttpFetcher (tallison: [https://github.com/apache/tika/commit/68a4272e4de38f6eb02a93e5bcce76b72dcc5eca])
* (edit) tika-pipes/tika-fetchers/tika-fetcher-http/src/main/java/org/apache/tika/pipes/fetcher/http/HttpFetcher.java
* (edit) CHANGES.txt
* (edit) tika-pipes/tika-fetchers/tika-fetcher-http/pom.xml
* (edit) tika-pipes/tika-emitters/tika-emitter-fs/src/main/java/org/apache/tika/pipes/emitter/fs/FileSystemEmitter.java
* (edit) tika-pipes/tika-fetchers/tika-fetcher-http/src/test/java/org/apache/tika/pipes/fetcher/http/HttpFetcherTest.java
* (edit) tika-pipes/tika-fetchers/tika-fetcher-http/src/test/resources/tika-config-http.xml


> Various improvements to http fetcher
> ------------------------------------
>
>                 Key: TIKA-3543
>                 URL: https://issues.apache.org/jira/browse/TIKA-3543
>             Project: Tika
>          Issue Type: Task
>            Reporter: Tim Allison
>            Priority: Minor
>
> Let users set maxRedirects.
> Let users select which http headers they'd like to store in the metadata.
> Record the "target" URL in the metadata -- the last redirect for a given URL.
> Let users select whether or not to spool to disk.
> Allow users to set a max bytes for content to spool to disk.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)