You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by GitBox <gi...@apache.org> on 2021/11/25 16:09:26 UTC

[GitHub] [nutch] sebastian-nagel commented on pull request #700: NUTCH-2891 Upgrade to Tika 2.1.0

sebastian-nagel commented on pull request #700:
URL: https://github.com/apache/nutch/pull/700#issuecomment-979330868


   Hi @lewismc, in addition to running local tests on just a few documents
   - a comparison of Tika parse results for an equivalent upgrade (/Digitalpebble/storm-crawler#920) showed that any custom extractors need to review metadata names. But the consolidation of Tika metadata names/keys is for sure an improvement for the long term.
   - just upgraded the [Common Crawl Nutch fork](/commoncrawl/nutch) and now running a crawl (several 100 million pages) with parse-tika enabled. I'll look for suspicious exceptions in the log files and will report tomorrow.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@nutch.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org