You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@tika.apache.org by Markus Jelsma <ma...@openindex.io> on 2011/06/30 13:45:35 UTC

Retrieve full DOM with BoilperpipeCH

Hi,

In Nutch, the BoilerpipeContentHandler returns only a partial DOM. Nutch uses 
the DOM parsed by Tika to find outlinks. So, whenever i use BP i can only 
retrieve a small amount of links, or even none at all.

I can work around this problem by parsing normally and later on send the 
(already parsed) input stream again to Tika but this time through BP.

This double parsing seems silly so i'm looking for advice on how to do this 
better. 

Thanks,