You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Jake Conk <ja...@gmail.com> on 2008/10/06 20:37:24 UTC
Stored field question
Hello,
I have a field with the following definition...
<dynamicField name="*_t_ns_mv" type="text" indexed="true"
stored="false" multiValued="true"/>
I'm not storing the data because I never need to retrieve it but each
*_t_ns_mv field is indexed and has a specific boost value... I added
this field with the word "test" as the value but when I search for
"test" no results come up in my unstored field unless I put the word
"test" in a field that is stored.
Do I have a misunderstanding of how to use stored/unstored fields? Can
someone help me clarify it?
Thanks,
- Jake C
Re: Stored field question
Posted by sunnyfr <jo...@gmail.com>.
It's ok ! thanks,
sunnyfr wrote:
>
> I did that but nothing changed ??
> root@solr-test:~# ps axf | grep java
> 23574 pts/0 S+ 0:00 \_ grep java
> 23390 ? Ss 0:00 /usr/bin/jsvc -user tomcat55 -cp
> /usr/share/java/commons-daemon.jar:/usr/share/tomcat5.5/bin/bootstrap.jar
> -outfile SYSLOG -errfile SYSLOG -pidfile /var/run/tomcat5.5.pid -Xms3000m
> -Xmx5000m -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelGC
> -XX:+AggressiveOpts -XX:NewRatio=5 -Xloggc:gc.log -XX:+PrintGCDetails
> -XX:+PrintGCTimeStamps
> -Djava.endorsed.dirs=/usr/share/tomcat5.5/common/endorsed
> -Dcatalina.base=/var/lib/tomcat5.5 -Dcatalina.home=/usr/share/tomcat5.5
> -Djava.io.tmpdir=/var/lib/tomcat5.5/temp
> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> -Djava.util.logging.config.file=/var/lib/tomcat5.5/conf/logging.properties
> org.apache.catalina.startup.Bootstrap
> 23391 ? S 0:00 \_ /usr/bin/jsvc -user tomcat55 -cp
> /usr/share/java/commons-daemon.jar:/usr/share/tomcat5.5/bin/bootstrap.jar
> -outfile SYSLOG -errfile SYSLOG -pidfile /var/run/tomcat5.5.pid -Xms3000m
> -Xmx5000m -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelGC
> -XX:+AggressiveOpts -XX:NewRatio=5 -Xloggc:gc.log -XX:+PrintGCDetails
> -XX:+PrintGCTimeStamps
> -Djava.endorsed.dirs=/usr/share/tomcat5.5/common/endorsed
> -Dcatalina.base=/var/lib/tomcat5.5 -Dcatalina.home=/usr/share/tomcat5.5
> -Djava.io.tmpdir=/var/lib/tomcat5.5/temp
> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> -Djava.util.logging.config.file=/var/lib/tomcat5.5/conf/logging.properties
> org.apache.catalina.startup.Bootstrap
> 23392 ? Sl 0:06 \_ /usr/bin/jsvc -user tomcat55 -cp
> /usr/share/java/commons-daemon.jar:/usr/share/tomcat5.5/bin/bootstrap.jar
> -outfile SYSLOG -errfile SYSLOG -pidfile /var/run/tomcat5.5.pid -Xms3000m
> -Xmx5000m -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelGC
> -XX:+AggressiveOpts -XX:NewRatio=5 -Xloggc:gc.log -XX:+PrintGCDetails
> -XX:+PrintGCTimeStamps
> -Djava.endorsed.dirs=/usr/share/tomcat5.5/common/endorsed
> -Dcatalina.base=/var/lib/tomcat5.5 -Dcatalina.home=/usr/share/tomcat5.5
> -Djava.io.tmpdir=/var/lib/tomcat5.5/temp
> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> -Djava.util.logging.config.file=/var/lib/tomcat5.5/conf/logging.properties
> org.apache.catalina.startup.Bootstrap
> root@solr-test:~# kill -3 23390
> root@solr-test:~# kill -3 23391
> root@solr-test:~# kill -3 23392
>
>
>
> Yonik Seeley wrote:
>>
>> On Tue, Oct 7, 2008 at 5:09 AM, sunnyfr <jo...@gmail.com> wrote:
>>> I've the same problem I think,
>>
>> It doesn't appear to be related to the original poster's problem.
>>
>>> I've add language fields and now commit start
>>> but never ending ... it stays stuck ...???
>>
>> Can you elaborate on this? What's in the solr log when this happens?
>> If commit is truly "stuck", can you provide a thread dump?
>>
>> -Yonik
>>
>>
>>> <field name="title" type="text" indexed="true"
>>> stored="false" />
>>> <field name="title_fr" type="text_fr"
>>> indexed="true"
>>> stored="false" />
>>> <field name="title_en" type="text_en"
>>> indexed="true"
>>> stored="false" />
>>> <field name="title_de" type="text_de"
>>> indexed="true"
>>> stored="false" />
>>> <field name="title_es" type="text_es"
>>> indexed="true"
>>> stored="false" />
>>> <field name="title_ru" type="text_ru"
>>> indexed="true"
>>> stored="false" />
>>> <field name="title_pt" type="text_pt"
>>> indexed="true"
>>> stored="false" />
>>> <field name="title_nl" type="text_nl"
>>> indexed="true"
>>> stored="false" />
>>> <field name="title_el" type="text_el"
>>> indexed="true"
>>> stored="false" />
>>> <field name="title_ja" type="text_ja"
>>> indexed="true"
>>> stored="false" />
>>> <field name="title_it" type="text_it"
>>> indexed="true"
>>> stored="false" />
>>>
>>> <field name="description" type="text" indexed="true"
>>> stored="false" />
>>> <field name="description_fr" type="text_fr"
>>> indexed="true"
>>> stored="false" />
>>> <field name="description_en" type="text_en"
>>> indexed="true"
>>> stored="false" />
>>> <field name="description_de" type="text_de"
>>> indexed="true"
>>> stored="false" />
>>> <field name="description_es" type="text_es"
>>> indexed="true"
>>> stored="false" />
>>> <field name="description_ru" type="text_ru"
>>> indexed="true"
>>> stored="false" />
>>> <field name="description_pt" type="text_pt"
>>> indexed="true"
>>> stored="false" />
>>> <field name="description_nl" type="text_nl"
>>> indexed="true"
>>> stored="false" />
>>> <field name="description_el" type="text_el"
>>> indexed="true"
>>> stored="false" />
>>> <field name="description_ja" type="text_ja"
>>> indexed="true"
>>> stored="false" />
>>> <field name="description_it" type="text_it"
>>> indexed="true"
>>> stored="false" />
>>>
>>>
>>>
>>> Yonik Seeley wrote:
>>>>
>>>> On Mon, Oct 6, 2008 at 2:37 PM, Jake Conk <ja...@gmail.com> wrote:
>>>>> I have a field with the following definition...
>>>>>
>>>>> <dynamicField name="*_t_ns_mv" type="text" indexed="true"
>>>>> stored="false" multiValued="true"/>
>>>>>
>>>>> I'm not storing the data because I never need to retrieve it but each
>>>>> *_t_ns_mv field is indexed and has a specific boost value... I added
>>>>> this field with the word "test" as the value but when I search for
>>>>> "test" no results come up in my unstored field unless I put the word
>>>>> "test" in a field that is stored.
>>>>>
>>>>> Do I have a misunderstanding of how to use stored/unstored fields? Can
>>>>> someone help me clarify it?
>>>>
>>>> You should be able to search on a field that is indexed but not stored
>>>> (otherwise there would be no point to indexed but not stored). Are
>>>> you sure you issued a commit after you added the document? Are you
>>>> sure you are searching that specific field? Searches are field
>>>> specific and do not cover all fields.
>>>>
>>>> -Yonik
>>>>
>>>>
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/Stored-field-question-tp19843705p19854225.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>
>
--
View this message in context: http://www.nabble.com/Stored-field-question-tp19843705p20034082.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Stored field question
Posted by sunnyfr <jo...@gmail.com>.
I did that but nothing changed ??
root@solr-test:~# ps axf | grep java
23574 pts/0 S+ 0:00 \_ grep java
23390 ? Ss 0:00 /usr/bin/jsvc -user tomcat55 -cp
/usr/share/java/commons-daemon.jar:/usr/share/tomcat5.5/bin/bootstrap.jar
-outfile SYSLOG -errfile SYSLOG -pidfile /var/run/tomcat5.5.pid -Xms3000m
-Xmx5000m -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelGC
-XX:+AggressiveOpts -XX:NewRatio=5 -Xloggc:gc.log -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps
-Djava.endorsed.dirs=/usr/share/tomcat5.5/common/endorsed
-Dcatalina.base=/var/lib/tomcat5.5 -Dcatalina.home=/usr/share/tomcat5.5
-Djava.io.tmpdir=/var/lib/tomcat5.5/temp
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.config.file=/var/lib/tomcat5.5/conf/logging.properties
org.apache.catalina.startup.Bootstrap
23391 ? S 0:00 \_ /usr/bin/jsvc -user tomcat55 -cp
/usr/share/java/commons-daemon.jar:/usr/share/tomcat5.5/bin/bootstrap.jar
-outfile SYSLOG -errfile SYSLOG -pidfile /var/run/tomcat5.5.pid -Xms3000m
-Xmx5000m -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelGC
-XX:+AggressiveOpts -XX:NewRatio=5 -Xloggc:gc.log -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps
-Djava.endorsed.dirs=/usr/share/tomcat5.5/common/endorsed
-Dcatalina.base=/var/lib/tomcat5.5 -Dcatalina.home=/usr/share/tomcat5.5
-Djava.io.tmpdir=/var/lib/tomcat5.5/temp
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.config.file=/var/lib/tomcat5.5/conf/logging.properties
org.apache.catalina.startup.Bootstrap
23392 ? Sl 0:06 \_ /usr/bin/jsvc -user tomcat55 -cp
/usr/share/java/commons-daemon.jar:/usr/share/tomcat5.5/bin/bootstrap.jar
-outfile SYSLOG -errfile SYSLOG -pidfile /var/run/tomcat5.5.pid -Xms3000m
-Xmx5000m -XX:+HeapDumpOnOutOfMemoryError -XX:+UseParallelGC
-XX:+AggressiveOpts -XX:NewRatio=5 -Xloggc:gc.log -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps
-Djava.endorsed.dirs=/usr/share/tomcat5.5/common/endorsed
-Dcatalina.base=/var/lib/tomcat5.5 -Dcatalina.home=/usr/share/tomcat5.5
-Djava.io.tmpdir=/var/lib/tomcat5.5/temp
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.config.file=/var/lib/tomcat5.5/conf/logging.properties
org.apache.catalina.startup.Bootstrap
root@solr-test:~# kill -3 23390
root@solr-test:~# kill -3 23391
root@solr-test:~# kill -3 23392
Yonik Seeley wrote:
>
> On Tue, Oct 7, 2008 at 5:09 AM, sunnyfr <jo...@gmail.com> wrote:
>> I've the same problem I think,
>
> It doesn't appear to be related to the original poster's problem.
>
>> I've add language fields and now commit start
>> but never ending ... it stays stuck ...???
>
> Can you elaborate on this? What's in the solr log when this happens?
> If commit is truly "stuck", can you provide a thread dump?
>
> -Yonik
>
>
>> <field name="title" type="text" indexed="true"
>> stored="false" />
>> <field name="title_fr" type="text_fr"
>> indexed="true"
>> stored="false" />
>> <field name="title_en" type="text_en"
>> indexed="true"
>> stored="false" />
>> <field name="title_de" type="text_de"
>> indexed="true"
>> stored="false" />
>> <field name="title_es" type="text_es"
>> indexed="true"
>> stored="false" />
>> <field name="title_ru" type="text_ru"
>> indexed="true"
>> stored="false" />
>> <field name="title_pt" type="text_pt"
>> indexed="true"
>> stored="false" />
>> <field name="title_nl" type="text_nl"
>> indexed="true"
>> stored="false" />
>> <field name="title_el" type="text_el"
>> indexed="true"
>> stored="false" />
>> <field name="title_ja" type="text_ja"
>> indexed="true"
>> stored="false" />
>> <field name="title_it" type="text_it"
>> indexed="true"
>> stored="false" />
>>
>> <field name="description" type="text" indexed="true"
>> stored="false" />
>> <field name="description_fr" type="text_fr"
>> indexed="true"
>> stored="false" />
>> <field name="description_en" type="text_en"
>> indexed="true"
>> stored="false" />
>> <field name="description_de" type="text_de"
>> indexed="true"
>> stored="false" />
>> <field name="description_es" type="text_es"
>> indexed="true"
>> stored="false" />
>> <field name="description_ru" type="text_ru"
>> indexed="true"
>> stored="false" />
>> <field name="description_pt" type="text_pt"
>> indexed="true"
>> stored="false" />
>> <field name="description_nl" type="text_nl"
>> indexed="true"
>> stored="false" />
>> <field name="description_el" type="text_el"
>> indexed="true"
>> stored="false" />
>> <field name="description_ja" type="text_ja"
>> indexed="true"
>> stored="false" />
>> <field name="description_it" type="text_it"
>> indexed="true"
>> stored="false" />
>>
>>
>>
>> Yonik Seeley wrote:
>>>
>>> On Mon, Oct 6, 2008 at 2:37 PM, Jake Conk <ja...@gmail.com> wrote:
>>>> I have a field with the following definition...
>>>>
>>>> <dynamicField name="*_t_ns_mv" type="text" indexed="true"
>>>> stored="false" multiValued="true"/>
>>>>
>>>> I'm not storing the data because I never need to retrieve it but each
>>>> *_t_ns_mv field is indexed and has a specific boost value... I added
>>>> this field with the word "test" as the value but when I search for
>>>> "test" no results come up in my unstored field unless I put the word
>>>> "test" in a field that is stored.
>>>>
>>>> Do I have a misunderstanding of how to use stored/unstored fields? Can
>>>> someone help me clarify it?
>>>
>>> You should be able to search on a field that is indexed but not stored
>>> (otherwise there would be no point to indexed but not stored). Are
>>> you sure you issued a commit after you added the document? Are you
>>> sure you are searching that specific field? Searches are field
>>> specific and do not cover all fields.
>>>
>>> -Yonik
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Stored-field-question-tp19843705p19854225.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
--
View this message in context: http://www.nabble.com/Stored-field-question-tp19843705p19856215.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Stored field question
Posted by Yonik Seeley <yo...@apache.org>.
On Tue, Oct 7, 2008 at 5:09 AM, sunnyfr <jo...@gmail.com> wrote:
> I've the same problem I think,
It doesn't appear to be related to the original poster's problem.
> I've add language fields and now commit start
> but never ending ... it stays stuck ...???
Can you elaborate on this? What's in the solr log when this happens?
If commit is truly "stuck", can you provide a thread dump?
-Yonik
> <field name="title" type="text" indexed="true"
> stored="false" />
> <field name="title_fr" type="text_fr" indexed="true"
> stored="false" />
> <field name="title_en" type="text_en" indexed="true"
> stored="false" />
> <field name="title_de" type="text_de" indexed="true"
> stored="false" />
> <field name="title_es" type="text_es" indexed="true"
> stored="false" />
> <field name="title_ru" type="text_ru" indexed="true"
> stored="false" />
> <field name="title_pt" type="text_pt" indexed="true"
> stored="false" />
> <field name="title_nl" type="text_nl" indexed="true"
> stored="false" />
> <field name="title_el" type="text_el" indexed="true"
> stored="false" />
> <field name="title_ja" type="text_ja" indexed="true"
> stored="false" />
> <field name="title_it" type="text_it" indexed="true"
> stored="false" />
>
> <field name="description" type="text" indexed="true"
> stored="false" />
> <field name="description_fr" type="text_fr" indexed="true"
> stored="false" />
> <field name="description_en" type="text_en" indexed="true"
> stored="false" />
> <field name="description_de" type="text_de" indexed="true"
> stored="false" />
> <field name="description_es" type="text_es" indexed="true"
> stored="false" />
> <field name="description_ru" type="text_ru" indexed="true"
> stored="false" />
> <field name="description_pt" type="text_pt" indexed="true"
> stored="false" />
> <field name="description_nl" type="text_nl" indexed="true"
> stored="false" />
> <field name="description_el" type="text_el" indexed="true"
> stored="false" />
> <field name="description_ja" type="text_ja" indexed="true"
> stored="false" />
> <field name="description_it" type="text_it" indexed="true"
> stored="false" />
>
>
>
> Yonik Seeley wrote:
>>
>> On Mon, Oct 6, 2008 at 2:37 PM, Jake Conk <ja...@gmail.com> wrote:
>>> I have a field with the following definition...
>>>
>>> <dynamicField name="*_t_ns_mv" type="text" indexed="true"
>>> stored="false" multiValued="true"/>
>>>
>>> I'm not storing the data because I never need to retrieve it but each
>>> *_t_ns_mv field is indexed and has a specific boost value... I added
>>> this field with the word "test" as the value but when I search for
>>> "test" no results come up in my unstored field unless I put the word
>>> "test" in a field that is stored.
>>>
>>> Do I have a misunderstanding of how to use stored/unstored fields? Can
>>> someone help me clarify it?
>>
>> You should be able to search on a field that is indexed but not stored
>> (otherwise there would be no point to indexed but not stored). Are
>> you sure you issued a commit after you added the document? Are you
>> sure you are searching that specific field? Searches are field
>> specific and do not cover all fields.
>>
>> -Yonik
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Stored-field-question-tp19843705p19854225.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
Re: Stored field question
Posted by sunnyfr <jo...@gmail.com>.
I've the same problem I think, I've add language fields and now commit start
but never ending ... it stays stuck ...???
<field name="title" type="text" indexed="true"
stored="false" />
<field name="title_fr" type="text_fr" indexed="true"
stored="false" />
<field name="title_en" type="text_en" indexed="true"
stored="false" />
<field name="title_de" type="text_de" indexed="true"
stored="false" />
<field name="title_es" type="text_es" indexed="true"
stored="false" />
<field name="title_ru" type="text_ru" indexed="true"
stored="false" />
<field name="title_pt" type="text_pt" indexed="true"
stored="false" />
<field name="title_nl" type="text_nl" indexed="true"
stored="false" />
<field name="title_el" type="text_el" indexed="true"
stored="false" />
<field name="title_ja" type="text_ja" indexed="true"
stored="false" />
<field name="title_it" type="text_it" indexed="true"
stored="false" />
<field name="description" type="text" indexed="true"
stored="false" />
<field name="description_fr" type="text_fr" indexed="true"
stored="false" />
<field name="description_en" type="text_en" indexed="true"
stored="false" />
<field name="description_de" type="text_de" indexed="true"
stored="false" />
<field name="description_es" type="text_es" indexed="true"
stored="false" />
<field name="description_ru" type="text_ru" indexed="true"
stored="false" />
<field name="description_pt" type="text_pt" indexed="true"
stored="false" />
<field name="description_nl" type="text_nl" indexed="true"
stored="false" />
<field name="description_el" type="text_el" indexed="true"
stored="false" />
<field name="description_ja" type="text_ja" indexed="true"
stored="false" />
<field name="description_it" type="text_it" indexed="true"
stored="false" />
Yonik Seeley wrote:
>
> On Mon, Oct 6, 2008 at 2:37 PM, Jake Conk <ja...@gmail.com> wrote:
>> I have a field with the following definition...
>>
>> <dynamicField name="*_t_ns_mv" type="text" indexed="true"
>> stored="false" multiValued="true"/>
>>
>> I'm not storing the data because I never need to retrieve it but each
>> *_t_ns_mv field is indexed and has a specific boost value... I added
>> this field with the word "test" as the value but when I search for
>> "test" no results come up in my unstored field unless I put the word
>> "test" in a field that is stored.
>>
>> Do I have a misunderstanding of how to use stored/unstored fields? Can
>> someone help me clarify it?
>
> You should be able to search on a field that is indexed but not stored
> (otherwise there would be no point to indexed but not stored). Are
> you sure you issued a commit after you added the document? Are you
> sure you are searching that specific field? Searches are field
> specific and do not cover all fields.
>
> -Yonik
>
>
--
View this message in context: http://www.nabble.com/Stored-field-question-tp19843705p19854225.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Stored field question
Posted by Yonik Seeley <yo...@apache.org>.
On Mon, Oct 6, 2008 at 2:37 PM, Jake Conk <ja...@gmail.com> wrote:
> I have a field with the following definition...
>
> <dynamicField name="*_t_ns_mv" type="text" indexed="true"
> stored="false" multiValued="true"/>
>
> I'm not storing the data because I never need to retrieve it but each
> *_t_ns_mv field is indexed and has a specific boost value... I added
> this field with the word "test" as the value but when I search for
> "test" no results come up in my unstored field unless I put the word
> "test" in a field that is stored.
>
> Do I have a misunderstanding of how to use stored/unstored fields? Can
> someone help me clarify it?
You should be able to search on a field that is indexed but not stored
(otherwise there would be no point to indexed but not stored). Are
you sure you issued a commit after you added the document? Are you
sure you are searching that specific field? Searches are field
specific and do not cover all fields.
-Yonik