You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Bryan Woliner <br...@gmail.com> on 2005/11/14 07:13:51 UTC

A couple of questions about the "date:" query

OK, I believe that I correctly included the "more indexing" and "more query"
plugins, which should allow searches using the "date:" query field. However,
I am current unable to search by date ranges. I tried to use the search
string that doug cutting suggested in an e-mail to the list on 9/12/2005. He
suggested,

If you want to see all documents in a date range, then perhaps try something
like "url:http date:19000101-20051231".


 However, when I try the suggested search string, zero pages are returned. I
believe the fact that I have included the "more" plugin is evidenced by the
content of my nutch-site.xml file and part of the output nutch generates
during a whole-web crawl, each of which are listed below. Any suggestions
are much appreciated.

On a separate, but related, note, I am unable to interpret the number that
apparently represents the date that a page was last modified. When I click
on the "(explain)" link next to a search result link, there is a field like
this: "lastModified = 1131904304000"

What date does this represent?

Here is the contents of my nutch-site.xml file:

_______________

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<nutch-conf>

<property>
<name>plugin.includes</name>

<value>nutch-extensionpoints|protocol-http|urlfilter-regex|parse-(text|html)|index-(basic|more)|query-(basic|site|url|more)</value>
<description>Regular expression naming plugin directory names to
include. Any plugin not matching this expression is excluded.
In any case you need at least include the nutch-extensionpoints plugin. By
default Nutch includes crawling just HTML and plain text via HTTP,
and basic indexing and search plugins.
</description>
</property>

</nutch-conf>
________________


Also, here is part of the output I get when I do a whole-web crawl:

________________
051113 232339 parsing: /usr/local/nutch-0.7.1/plugins/query-basic/plugin.xml
051113 232339 impl: point=org.apache.nutch.searcher.QueryFilter class=
org.apache.nutch.searcher.basic.BasicQueryFilter
051113 232339 parsing: /usr/local/nutch-0.7.1/plugins/query-more/plugin.xml
051113 232339 impl: point=org.apache.nutch.searcher.QueryFilter class=
org.apache.nutch.searcher.more.TypeQueryFilter
051113 232339 impl: point=org.apache.nutch.searcher.QueryFilter class=
org.apache.nutch.searcher.more.DateQueryFilter
051113 232339 parsing: /usr/local/nutch-0.7.1/plugins/query-site/plugin.xml
051113 232339 impl: point=org.apache.nutch.searcher.QueryFilter class=
org.apache.nutch.searcher.site.SiteQueryFilter
051113 232339 parsing: /usr/local/nutch-0.7.1/plugins/query-url/plugin.xml
051113 232339 impl: point=org.apache.nutch.searcher.QueryFilter class=
org.apache.nutch.searcher.url.URLQueryFilter
_________________

Thanks for any suggestions,
Bryan