You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by kiran chitturi <ch...@gmail.com> on 2012/10/25 20:44:17 UTC

Nutch 2.x Eclipse: Can't retrieve Tika parser for mime-type application/pdf

Hi,

i have built Nutch 2.x in eclipse using this tutorial (
http://wiki.apache.org/nutch/RunNutchInEclipse) and with some modifications.

Its able to parse html files successfully but when it comes to pdf files it
says 2012-10-25 14:37:05,071 ERROR tika.TikaParser - Can't retrieve Tika
parser for mime-type application/pdf

Is there anything wrong with my eclipse configuration? I am looking to
debug some  things in nutch, so i am working with eclipse and nutch.

Do i need to point any libraries for eclipseto recognize tika parsers for
application/pdf type ?

What exactly is the reason for this type of error to appear for only pdf
files and not html files ? I am using recent nutch 2.x which has tika
upgraded to 1.2

I would like some help here and would like to know if anyone has
encountered similar problem with eclipse, nutch 2.x and parsing
application/pdf files ?

Many Thanks,
-- 
Kiran Chitturi

RE: Nutch 2.x Eclipse: Can't retrieve Tika parser for mime-type application/pdf

Posted by Markus Jelsma <ma...@openindex.io>.
Hi,
 
-----Original message-----
> From:kiran chitturi <ch...@gmail.com>
> Sent: Thu 25-Oct-2012 20:49
> To: user@nutch.apache.org
> Subject: Nutch 2.x Eclipse: Can't retrieve Tika parser for mime-type application/pdf
> 
> Hi,
> 
> i have built Nutch 2.x in eclipse using this tutorial (
> http://wiki.apache.org/nutch/RunNutchInEclipse) and with some modifications.
> 
> Its able to parse html files successfully but when it comes to pdf files it
> says 2012-10-25 14:37:05,071 ERROR tika.TikaParser - Can't retrieve Tika
> parser for mime-type application/pdf
> 
> Is there anything wrong with my eclipse configuration? I am looking to
> debug some  things in nutch, so i am working with eclipse and nutch.
> 
> Do i need to point any libraries for eclipseto recognize tika parsers for
> application/pdf type ?
> 
> What exactly is the reason for this type of error to appear for only pdf
> files and not html files ? I am using recent nutch 2.x which has tika
> upgraded to 1.2

This is possible if the PDFBox dependancy is not found anywhere or is wrongly mapped in Tika's plugin.xml. The above error can also happen if you happen to have a tika-parsers-VERSION.jar in your runtime/local/lib directory, for some strange reason.

> 
> I would like some help here and would like to know if anyone has
> encountered similar problem with eclipse, nutch 2.x and parsing
> application/pdf files ?
> 
> Many Thanks,
> -- 
> Kiran Chitturi
> 

Re: Nutch 2.x Eclipse: Can't retrieve Tika parser for mime-type application/pdf

Posted by kiran chitturi <ch...@gmail.com>.
Thank you very much. This has worked great and resolved the issue of
finding parser.

One interesting thing is out of 10 pdf files, it has crawled 2 files and
said unsuccessful for other pdf files. This has happened like 10 times for
now.

I really need to debug and put more error messages than just 'unable to
succesfully parse content ..'

Thanks again,
Kiran.

On Fri, Oct 26, 2012 at 4:16 AM, Julien Nioche <
lists.digitalpebble@gmail.com> wrote:

> >
> > Is there anything wrong with my eclipse configuration? I am looking to
> > debug some  things in nutch, so i am working with eclipse and nutch.
>
>
> easier to follow the steps in Remote Debugging in Eclipse from
> http://wiki.apache.org/nutch/RunNutchInEclipse
>
> it will save you all sorts of classpath issues etc... note that this works
> in local mode only
>
> HTH
>
> Julien
>
>
> On 25 October 2012 19:44, kiran chitturi <ch...@gmail.com>
> wrote:
>
> > Hi,
> >
> > i have built Nutch 2.x in eclipse using this tutorial (
> > http://wiki.apache.org/nutch/RunNutchInEclipse) and with some
> > modifications.
> >
> > Its able to parse html files successfully but when it comes to pdf files
> it
> > says 2012-10-25 14:37:05,071 ERROR tika.TikaParser - Can't retrieve Tika
> > parser for mime-type application/pdf
> >
> > Is there anything wrong with my eclipse configuration? I am looking to
> > debug some  things in nutch, so i am working with eclipse and nutch.
> >
> > Do i need to point any libraries for eclipseto recognize tika parsers for
> > application/pdf type ?
> >
> > What exactly is the reason for this type of error to appear for only pdf
> > files and not html files ? I am using recent nutch 2.x which has tika
> > upgraded to 1.2
> >
> > I would like some help here and would like to know if anyone has
> > encountered similar problem with eclipse, nutch 2.x and parsing
> > application/pdf files ?
> >
> > Many Thanks,
> > --
> > Kiran Chitturi
> >
>
>
>
> --
> *
> *Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
> http://twitter.com/digitalpebble
>



-- 
Kiran Chitturi

Re: Nutch 2.x Eclipse: Can't retrieve Tika parser for mime-type application/pdf

Posted by Julien Nioche <li...@gmail.com>.
>
> Is there anything wrong with my eclipse configuration? I am looking to
> debug some  things in nutch, so i am working with eclipse and nutch.


easier to follow the steps in Remote Debugging in Eclipse from
http://wiki.apache.org/nutch/RunNutchInEclipse

it will save you all sorts of classpath issues etc... note that this works
in local mode only

HTH

Julien


On 25 October 2012 19:44, kiran chitturi <ch...@gmail.com> wrote:

> Hi,
>
> i have built Nutch 2.x in eclipse using this tutorial (
> http://wiki.apache.org/nutch/RunNutchInEclipse) and with some
> modifications.
>
> Its able to parse html files successfully but when it comes to pdf files it
> says 2012-10-25 14:37:05,071 ERROR tika.TikaParser - Can't retrieve Tika
> parser for mime-type application/pdf
>
> Is there anything wrong with my eclipse configuration? I am looking to
> debug some  things in nutch, so i am working with eclipse and nutch.
>
> Do i need to point any libraries for eclipseto recognize tika parsers for
> application/pdf type ?
>
> What exactly is the reason for this type of error to appear for only pdf
> files and not html files ? I am using recent nutch 2.x which has tika
> upgraded to 1.2
>
> I would like some help here and would like to know if anyone has
> encountered similar problem with eclipse, nutch 2.x and parsing
> application/pdf files ?
>
> Many Thanks,
> --
> Kiran Chitturi
>



-- 
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble