You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Arnaud Goupil <go...@yahoo.fr> on 2006/12/11 12:33:20 UTC
PDF : no result...
Hi,
Sorry, I know that many posts have been sent about
this subject, but I still have a problem with PDF
files in Nutch 0.8.1 :
I crawl a little place of my Intranet with the command
line above :
bin/nutch crawl urls dir crawldir depth 3
* PDF files are fetched :
fetching
http://my.intranet.fr/essairecherche/moinf015.pdf
* Then, they are indexed :
Indexing
[http://my.intranet.fr/essairecherche/moinf015.pdf]
with analyzer
org.apache.nutch.analysis.NutchDocumentAnalyzer@1e2befa
(null)
In my NutchHome/conf/nutch-default.xml, I have set :
http.content.limit to -1
indexer.max.tokens to 9000000
plugin.includes to :
protocol-http|urlfilter-regex|parse-(text|html|js|pdf|msword|mspowerpoint|msexcel)|index-basic|query-(basic|site|url)|summary-basic|scoring-opic|analysis-(fr)
I have verified that my crawl-urlfilter.txt file
doesn't contain "pdf" in the "skip" section.
However, when I search particular terms that I know
being in the pdf files that are indexed, I keep
getting no result.
What did I forget ?
What is PDFbox and does it have something to do with
my problem ? Do I need to install this ?
Thanks
___________________________________________________________________________
Découvrez une nouvelle façon d'obtenir des réponses à toutes vos questions !
Profitez des connaissances, des opinions et des expériences des internautes sur Yahoo! Questions/Réponses
http://fr.answers.yahoo.com
Nutching different languages and encodings
Posted by Daniel López <D....@uib.es>.
Hi,
After being able to search and show the content type, etc, now I came
across the problem that my web pages, encoded in ISO-8859-1, are not
"properly" indexed as the summaries and titles are missing the "non
UTF-8" characters.
I tried specifying the property
*******************************************************************
<property>
<name>parser.character.encoding.default</name>
<value>ISO-8859-1</value>
</property>
*******************************************************************
but it made no difference.
On a related note, I can see that my documents have been properly
identified with the "language-identifier" plugin and I can see the
"lang" detail on the hits. However, I'm trying to do a search limited to
the documents in one given language but I cannot get the query to
identify which language I'm talking about.
I tried using the same way one can search documents from one site using
"site:my.site.com criteria" but using lang, language, Language... but
nothing works and I can see in the logs:
**************
061211 145357 10 query: lang:ca CRUE
061211 145357 10 Language: null <<<<<<< here it should read ca??
061211 145357 10 searching for 20 raw hits
**************
I tried browsing the documentation and searching the web but I could not
find explicit information on how to build the query to make use of that
field, now that I know the documents are properly indexed.
Any hints on those subjects?
Thanks in advance,
D.