You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Jörg Agatz <jo...@googlemail.com> on 2010/05/25 16:06:36 UTC
question about indexing...
I have a work!,
i musst indexing a lot of E-Mails, so i will create a Script to generate me
a xml of the Mails.
Now is the question, what happens when i creade a field "body" and in this
field comes a lot of "<" or ">" like this:
Confidentiality Caution: This message and all its included content and
assets are confidential and for the individual use of the entity to
whom it is send to only. If you, the reader of this message, have
recieved this communication by error please notify me about this
immediately, by return address, and delete the message and its assets.
Thank you.
> Apropos: In eurem Footer scheint ein "r" zu fehlen (Headqua_r_ter).
>
> Snapt Pty Ltd: Stephan Plesnik schrieb:
>>
>> Headquaters:
>
> --------------------------------------------------------------------
> Diese E-Mail, einschließlich sämtlicher mit ihr übertragenen Dateie
> n,
> ist vertraulich und ist für die ausschließliche Verwendung durch die
> Person oder das Unternehmen vorgesehen, an die/das sie adressiert ist.
> Sollten Sie diese E-Mail fälschlicherweise erhalten haben,
> benachrichtigen Sie bitte unseren Systemverwalter
> (service@plesnik.de).
> Diese E-Mail wurde auf die Abwesenheit von Computerviren überprüft.
> ---
> --------------------------------------------------------------------
Or
<hallo Mr. xy>
<thanks for greats>
<dear Mr. xyz>
I think it dosen´t Work!
howcan i make it, so that each content inpuit in the Solr
Re: question about indexing...
Posted by Erik Hatcher <er...@gmail.com>.
You have to provide more details than that. We need to know the field
definition for that named field, the corresponding field type
definition, and the exact request you're making to Solr that you think
should find this document.
And most importantly, did you <commit/> :)
Erik
On May 25, 2010, at 11:22 AM, Jörg Agatz wrote:
> ok, done..
>
> But now i dosent find any word in the CDATA field.
> i make :
>
> <field name="P_CONTENT_ITEMS_COMMENT"><![CDATA[
> Hallo leute. mein name ist dein name und wir wollen eigentlich nur
> unsere
> Ruhe haben.
> <b>ich du er sie es</b>
> Ha ha Ha ha ha ha ha ha ha ha
> ]]></field>
>
> it is a string field Multivalued..
>
> King
Re: question about indexing...
Posted by Erik Hatcher <er...@gmail.com>.
On May 26, 2010, at 3:49 AM, Jörg Agatz wrote:
> is the Textfield Single instance? how can i make it?
I'm not sure what you're asking. You can have as many "text" fields
as you like, or as many of any other type as well.
> In textfield indext the Word :
> "Hallo"
>
> if i search
> "Hallo" i found
> "hallo" i found
> "Hall*" i dont
> "hall*" i found
>
> But some user will search "Hall*"
Wildcard queries do not get analyzed, and thus the case stays the same
as the original query. Lowercase the query string before sending it
to Solr if you need to support Hall* queries.
> One more little Question i have...
>
> The Difference from "text", "string", "textgen" ect..
> Where i can sort, where i can search ect.
>
> i do not found a list of carakter of each type.
Pick up a copy of Lucid's Solr reference guide to have handy: <http://www.lucidimagination.com/Downloads/LucidWorks-for-Solr/Reference-Guide
> and start tinkering with Solr's analysis page, which you'll find at http://localhost:8983/solr/admin/analysis.jsp
- that tool will let you see how various field types index your text.
Erik
Re: question about indexing...
Posted by Jörg Agatz <jo...@googlemail.com>.
OK, Done.. i reboot the Server.
Now it works..
is the Textfield Single instance? how can i make it?
In textfield indext the Word :
"Hallo"
if i search
"Hallo" i found
"hallo" i found
"Hall*" i dont
"hall*" i found
But some user will search "Hall*"
One more little Question i have...
The Difference from "text", "string", "textgen" ect..
Where i can sort, where i can search ect.
i do not found a list of carakter of each type.
Re: question about indexing...
Posted by Jörg Agatz <jo...@googlemail.com>.
Sorry, i mean:
The XML like This:
<field name="P_CONTENT_ITEMS_COMMENT"><![CDATA[
Hallo leute. mein name ist dein name und wir wollen eigentlich nur unsere
Ruhe haben.
<b>ich du er sie es</b>
Ha ha Ha ha ha ha ha ha ha ha
]]></field>
Re: question about indexing...
Posted by Jörg Agatz <jo...@googlemail.com>.
Ok, Done...
But no changes!
I have the following in the Schema.xml Made:
<field name="all" type="string" indexed="true" stored="true"
multiValued="true"/>
<field name="P_CONTENT_ITEMS_COMMENT" type="text" indexed="true"
stored="true" multiValued="true"/>
<field name="comment" type="string" indexed="true" stored="true"
multiValued="true"/>
<copyField source="P_CONTENT_ITEMS_COMMENT" dest="all"/>
<defaultSearchField>all</defaultSearchField>
The XML like This:
<field name="COMMENT"><![CDATA[
Hallo leute. mein name ist dein name und wir wollen eigentlich nur unsere
Ruhe haben.
<b>ich du er sie es</b>
Ha ha Ha ha ha ha ha ha ha ha
]]></field>
i search "hallo" "Hallo" "leute" or "name" but i caqnt Find anythink.
"*:*" brings me the one indexed file.
What happens?
Re: question about indexing...
Posted by Erick Erickson <er...@gmail.com>.
Don't forget to re-index after you make the change Lance suggested...
Erick
On Tue, May 25, 2010 at 4:51 PM, Lance Norskog <go...@gmail.com> wrote:
> Change type="string" to type="text". This causes the field to be
> analyzed and then searching on words finds the document.
>
>
>
> On Tue, May 25, 2010 at 8:34 AM, Jörg Agatz <jo...@googlemail.com>
> wrote:
> > i create a new Index, but nothing Change.
> >
> > <field name="COMMENT" type="string" indexed="true" stored="true"
> > multiValued="true"/>
> >
> >
> >
> >
> >
> > <field name="COMMENT"
> >><![CDATA[
> > Hallo leute. mein name ist dein name und wir wollen eigentlich nur unsere
> > Ruhe haben.
> > <b>ich du er sie es</b>
> > Ha ha Ha ha ha ha ha ha ha ha
> > ]]></field>
> >
> > I search for :
> >
> > " *:* "
> > I fond it
> >
> > i search vor "hallo" "Hallo" "hallo*" "Hallo*"or some other content from
> the
> > CDATA field i dosent.
> >
>
>
>
> --
> Lance Norskog
> goksron@gmail.com
>
Re: question about indexing...
Posted by Lance Norskog <go...@gmail.com>.
Change type="string" to type="text". This causes the field to be
analyzed and then searching on words finds the document.
On Tue, May 25, 2010 at 8:34 AM, Jörg Agatz <jo...@googlemail.com> wrote:
> i create a new Index, but nothing Change.
>
> <field name="COMMENT" type="string" indexed="true" stored="true"
> multiValued="true"/>
>
>
>
>
>
> <field name="COMMENT"
>><![CDATA[
> Hallo leute. mein name ist dein name und wir wollen eigentlich nur unsere
> Ruhe haben.
> <b>ich du er sie es</b>
> Ha ha Ha ha ha ha ha ha ha ha
> ]]></field>
>
> I search for :
>
> " *:* "
> I fond it
>
> i search vor "hallo" "Hallo" "hallo*" "Hallo*"or some other content from the
> CDATA field i dosent.
>
--
Lance Norskog
goksron@gmail.com
Re: question about indexing...
Posted by Jörg Agatz <jo...@googlemail.com>.
i create a new Index, but nothing Change.
<field name="COMMENT" type="string" indexed="true" stored="true"
multiValued="true"/>
<field name="COMMENT"
><![CDATA[
Hallo leute. mein name ist dein name und wir wollen eigentlich nur unsere
Ruhe haben.
<b>ich du er sie es</b>
Ha ha Ha ha ha ha ha ha ha ha
]]></field>
I search for :
" *:* "
I fond it
i search vor "hallo" "Hallo" "hallo*" "Hallo*"or some other content from the
CDATA field i dosent.
Re: question about indexing...
Posted by Jörg Agatz <jo...@googlemail.com>.
ok, done..
But now i dosent find any word in the CDATA field.
i make :
<field name="P_CONTENT_ITEMS_COMMENT"><![CDATA[
Hallo leute. mein name ist dein name und wir wollen eigentlich nur unsere
Ruhe haben.
<b>ich du er sie es</b>
Ha ha Ha ha ha ha ha ha ha ha
]]></field>
it is a string field Multivalued..
King
Re: question about indexing...
Posted by Erik Hatcher <er...@gmail.com>.
Well, you'll just have to create valid XML, either encoding some
characters or using CDATA sections.
Erik
On May 25, 2010, at 10:06 AM, Jörg Agatz wrote:
> I have a work!,
> i musst indexing a lot of E-Mails, so i will create a Script to
> generate me
> a xml of the Mails.
>
> Now is the question, what happens when i creade a field "body" and
> in this
> field comes a lot of "<" or ">" like this:
> Confidentiality Caution: This message and all its included content and
>
> assets are confidential and for the individual use of the entity to
> whom it is send to only. If you, the reader of this message, have
> recieved this communication by error please notify me about this
> immediately, by return address, and delete the message and its assets.
> Thank you.
>> Apropos: In eurem Footer scheint ein "r" zu fehlen (Headqua_r_ter).
>>
>> Snapt Pty Ltd: Stephan Plesnik schrieb:
>>>
>>> Headquaters:
>
>>
>
>> --------------------------------------------------------------------
>> Diese E-Mail, einschließlich sämtlicher mit ihr übertragenen Dateie
>> n,
>> ist vertraulich und ist für die ausschließliche Verwendung durch die
>> Person oder das Unternehmen vorgesehen, an die/das sie adressiert
>> ist.
>> Sollten Sie diese E-Mail fälschlicherweise erhalten haben,
>> benachrichtigen Sie bitte unseren Systemverwalter
>> (service@plesnik.de).
>> Diese E-Mail wurde auf die Abwesenheit von Computerviren überprüft.
>> ---
>> --------------------------------------------------------------------
>
> Or
>
> <hallo Mr. xy>
> <thanks for greats>
> <dear Mr. xyz>
>
>
> I think it dosen´t Work!
> howcan i make it, so that each content inpuit in the Solr