You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by Apache Wiki <wi...@apache.org> on 2018/05/26 15:50:44 UTC

[Solr Wiki] Update of "RecommendExternalProgramTika" by ShawnHeisey

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "RecommendExternalProgramTika" page has been changed by ShawnHeisey:
https://wiki.apache.org/solr/RecommendExternalProgramTika

Comment:
Initial page creation.

New page:
<<TableOfContents>>

= Introduction =
[[http://tika.apache.org/|Tika]] is an Apache software project that is capable of parsing a large number of rich document formats, including PDF, Microsoft Office, and many others.

Solr includes a handler that utilizes Tika, the ExtractingRequestHandler, also known as SolrCell.

= Don't use ERH in production =

Rich document formats are frequently not well documented, and even in cases where there IS documentation for the format, not everyone who creates documents will follow the specifications faithfully.  This creates a situation where software like Tika may encounter something that it is simply not able to handle gracefully.  Although the authors put a LOT of effort into making sure the software runs well in unexpected situations, the reality is that sometimes a document will cause the software to malfunction and even crash.

If the Tika software included in Solr for SolrCell crashes, that means that Solr itself is going to crash too.  That is why it is not recommended for production use.  The ExtractingRequestHandler is a proof-of-concept tool that can get you started with parsing rich documents, but for production we strongly recommend writing an external program that incorporates Tika and sends the discovered data to Solr.

There is some [[https://lucidworks.com/2012/02/14/indexing-with-solrj/|example code]] on the Lucidworks blog.