You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tika.apache.org by eShard <zi...@yahoo.com> on 2014/03/28 18:59:04 UTC

How to exclude a mimetype form being indexed in solr using tika?

Good afternoon,
I already asked this question in the solr - user forum and I didn't get
anywhere.
They suggested I ask the tika community...
I'm using solr 4.0 Final
I need movies "hidden" in zip files that need to be excluded from the index.
I can't filter movies on the crawler because then I would have to exclude
all zip files.

I was told I can have tika skip the movies.
the details are escaping me at this point.

How do I exclude a file in the tika configuration?
I assume it's something I add in the update/extract handler but I'm not
sure.

Thanks, 



--
View this message in context: http://lucene.472066.n3.nabble.com/How-to-exclude-a-mimetype-form-being-indexed-in-solr-using-tika-tp4127767.html
Sent from the Apache Tika - Development mailing list archive at Nabble.com.

Re: How to exclude a mimetype form being indexed in solr using tika?

Posted by eShard <zi...@yahoo.com>.
Thanks for the reply,
I'll investigate the EmbeddedDocumentExtractor

the solr community told me it is a tika issue and the tika community told me
it's a solr issue...
Oh boy... :(



--
View this message in context: http://lucene.472066.n3.nabble.com/How-to-exclude-a-mimetype-from-being-indexed-in-solr-using-tika-tp4127767p4128188.html
Sent from the Apache Tika - Development mailing list archive at Nabble.com.

Re: How to exclude a mimetype form being indexed in solr using tika?

Posted by Nick Burch <ap...@gagravarr.org>.
On Fri, 28 Mar 2014, eShard wrote:
> I'm using solr 4.0 Final
> I need movies "hidden" in zip files that need to be excluded from the index.
> I can't filter movies on the crawler because then I would have to exclude
> all zip files.

If you're calling Tika directly, this is very easy. When tika hits 
embedded resources, it'll call out to your code, and you can select then 
if you want to process each one or ignore each one

(This is all done via an EmbeddedDocumentExtractor, which you supply on 
the ParseContext)

> How do I exclude a file in the tika configuration? I assume it's 
> something I add in the update/extract handler but I'm not sure.

I've no idea how / if you can tell the SOLR code to ask Tika to do that or 
not, that's something you'll have to go back to the SOLR community about 
as they maintain that code

Nick