You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@manifoldcf.apache.org by "Markus Schuch (Jira)" <ji...@apache.org> on 2019/08/22 15:11:00 UTC
[jira] [Updated] (CONNECTORS-1620) Accept Sitemaps with content
type application/xml
[ https://issues.apache.org/jira/browse/CONNECTORS-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus Schuch updated CONNECTORS-1620:
--------------------------------------
Description:
Given an Output Connection, that does not accepts the MIME type {{application/xml}} for ingestion, it is currently not possible to crawl a sitemap.xml, when the webserver returns {{application/xml}} as content type for the sitemap.
The sitemap is discarded before the links are extracted, because the mime type {{application/xml}} is not listed in the {{interestingMimeTypeArray}}.
was:
Given an Output Connection, that does not accepts the MIME type {{application/xml}} for ingestion, it is currently not possible to crawl a sitemap.xml, when the webserver returns {{application/xml}} as content type for the sitemap.
The sitemap is discarded before the links are extracted.
> Accept Sitemaps with content type application/xml
> -------------------------------------------------
>
> Key: CONNECTORS-1620
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1620
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Web connector
> Reporter: Markus Schuch
> Assignee: Markus Schuch
> Priority: Major
>
> Given an Output Connection, that does not accepts the MIME type {{application/xml}} for ingestion, it is currently not possible to crawl a sitemap.xml, when the webserver returns {{application/xml}} as content type for the sitemap.
> The sitemap is discarded before the links are extracted, because the mime type {{application/xml}} is not listed in the {{interestingMimeTypeArray}}.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)