You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Jim Chandler <ja...@gmail.com> on 2012/07/05 17:02:56 UTC
NutchField
Greetings All,
I'm trying to write access NutchFields that have been written to the
NutchDocument earlier by the index-more plugin. When I use
NutchDocument.getFields() all that is returned is the segment and digest
fields. I know that index-more adds date, type, content-length. Could
someone point me in the right direction?
Thanks,
Jim
Re: NutchField
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Jim,
There really isn't a better description out there than the one
provided in your solrindex-mapping.xml regarding what this file is
used for.
On Mon, Jul 9, 2012 at 2:02 PM, Jim Chandler <ja...@gmail.com> wrote:
> I'm assuming you meant solrindex-mapping.xml, which I did not have in my
> solr conf directory. I copied that over and still got the same error.
OK so you need to ensure that your Nutch schema.xml is the same one
used within your Solr server before starting it up. If you make
changes, then you'll need to restart your Solr server as currently
AFAIK this is not loaded dynamically.
>
> I'm not sure what I would be looking for at this point. If I add fields to
> the schema.xml should I also add them to the solrindex-mapping.xml.
>
Yeah, this is also explained within the file.
hth
Lewis
--
Lewis
Re: NutchField
Posted by Jim Chandler <ja...@gmail.com>.
John,
I'm assuming you meant solrindex-mapping.xml, which I did not have in my
solr conf directory. I copied that over and still got the same error.
I'm not sure what I would be looking for at this point. If I add fields to
the schema.xml should I also add them to the solrindex-mapping.xml.
Thanks,
Jim
On Thu, Jul 5, 2012 at 3:02 PM, Lewis John Mcgibbney <
lewis.mcgibbney@gmail.com> wrote:
> How is your schema and accompanying solr-mapping.xml?
>
> These need to be spot on or else you can expect sometimes confusing
> results.
>
> hth
>
> On Thu, Jul 5, 2012 at 7:58 PM, Jim Chandler <ja...@gmail.com>
> wrote:
> > Markus,
> >
> > Thanks for the speedy reply.
> >
> > I attempted your suggestion and my error changed now I'm getting:
> >
> > org.apache.solr.common.SolrException: [doc=null] missing required field:
> id
> >
> > I am relatively new at this and all help is very appreciated.
> >
> > Thanks
> >
> > On Thu, Jul 5, 2012 at 11:41 AM, Markus Jelsma
> > <ma...@openindex.io>wrote:
> >
> >> Hello,
> >>
> >> The index-more plugin might run after your custom plugin. You can
> >> configure the order in which plugins are run. Please consult the
> >> indexingfilter.order directive's description.in conf/nutch-default.xml.
> >>
> >> Cheers,
> >>
> >>
> >>
> >>
> >> -----Original message-----
> >> > From:Jim Chandler <ja...@gmail.com>
> >> > Sent: Thu 05-Jul-2012 17:04
> >> > To: user@nutch.apache.org
> >> > Subject: NutchField
> >> >
> >> > Greetings All,
> >> >
> >> > I'm trying to write access NutchFields that have been written to the
> >> > NutchDocument earlier by the index-more plugin. When I use
> >> > NutchDocument.getFields() all that is returned is the segment and
> digest
> >> > fields. I know that index-more adds date, type, content-length.
> Could
> >> > someone point me in the right direction?
> >> >
> >> > Thanks,
> >> > Jim
> >> >
> >>
>
>
>
> --
> Lewis
>
Re: NutchField
Posted by Lewis John Mcgibbney <le...@gmail.com>.
How is your schema and accompanying solr-mapping.xml?
These need to be spot on or else you can expect sometimes confusing results.
hth
On Thu, Jul 5, 2012 at 7:58 PM, Jim Chandler <ja...@gmail.com> wrote:
> Markus,
>
> Thanks for the speedy reply.
>
> I attempted your suggestion and my error changed now I'm getting:
>
> org.apache.solr.common.SolrException: [doc=null] missing required field: id
>
> I am relatively new at this and all help is very appreciated.
>
> Thanks
>
> On Thu, Jul 5, 2012 at 11:41 AM, Markus Jelsma
> <ma...@openindex.io>wrote:
>
>> Hello,
>>
>> The index-more plugin might run after your custom plugin. You can
>> configure the order in which plugins are run. Please consult the
>> indexingfilter.order directive's description.in conf/nutch-default.xml.
>>
>> Cheers,
>>
>>
>>
>>
>> -----Original message-----
>> > From:Jim Chandler <ja...@gmail.com>
>> > Sent: Thu 05-Jul-2012 17:04
>> > To: user@nutch.apache.org
>> > Subject: NutchField
>> >
>> > Greetings All,
>> >
>> > I'm trying to write access NutchFields that have been written to the
>> > NutchDocument earlier by the index-more plugin. When I use
>> > NutchDocument.getFields() all that is returned is the segment and digest
>> > fields. I know that index-more adds date, type, content-length. Could
>> > someone point me in the right direction?
>> >
>> > Thanks,
>> > Jim
>> >
>>
--
Lewis
Re: NutchField
Posted by Jim Chandler <ja...@gmail.com>.
Markus,
Thanks for the speedy reply.
I attempted your suggestion and my error changed now I'm getting:
org.apache.solr.common.SolrException: [doc=null] missing required field: id
I am relatively new at this and all help is very appreciated.
Thanks
On Thu, Jul 5, 2012 at 11:41 AM, Markus Jelsma
<ma...@openindex.io>wrote:
> Hello,
>
> The index-more plugin might run after your custom plugin. You can
> configure the order in which plugins are run. Please consult the
> indexingfilter.order directive's description.in conf/nutch-default.xml.
>
> Cheers,
>
>
>
>
> -----Original message-----
> > From:Jim Chandler <ja...@gmail.com>
> > Sent: Thu 05-Jul-2012 17:04
> > To: user@nutch.apache.org
> > Subject: NutchField
> >
> > Greetings All,
> >
> > I'm trying to write access NutchFields that have been written to the
> > NutchDocument earlier by the index-more plugin. When I use
> > NutchDocument.getFields() all that is returned is the segment and digest
> > fields. I know that index-more adds date, type, content-length. Could
> > someone point me in the right direction?
> >
> > Thanks,
> > Jim
> >
>
RE: NutchField
Posted by Markus Jelsma <ma...@openindex.io>.
Hello,
The index-more plugin might run after your custom plugin. You can configure the order in which plugins are run. Please consult the indexingfilter.order directive's description.in conf/nutch-default.xml.
Cheers,
-----Original message-----
> From:Jim Chandler <ja...@gmail.com>
> Sent: Thu 05-Jul-2012 17:04
> To: user@nutch.apache.org
> Subject: NutchField
>
> Greetings All,
>
> I'm trying to write access NutchFields that have been written to the
> NutchDocument earlier by the index-more plugin. When I use
> NutchDocument.getFields() all that is returned is the segment and digest
> fields. I know that index-more adds date, type, content-length. Could
> someone point me in the right direction?
>
> Thanks,
> Jim
>