solr query- get results without scanning files

[dafnashkedy <da...@yahoo.com>]

I would like to execute a solr query and get only the uniquKey I've defined.
The documents are very big so defining fl='my_key' is not fast enough - all
the matching documents are still scanned and the query can take hours (even
though the search itself was fast - numFound takes few seconds to return).
I should mention that all the data is stored, and creating a new index is
not an option.

One idea I had was to get the docIds of the results and map them to my_key
in the code.
I used fl=[docid], thinking it doesn't need scanning to get this info, but
it still takes too long to return.

Is there a better way to get the docIds?
Or a way to unstore certain fields without reindexing?
Or perhapse a compeletly different way to get the results without scanning
all the fields?

Thanks,

Dafna



--
View this message in context: http://lucene.472066.n3.nabble.com/solr-query-get-results-without-scanning-files-tp4059798.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr query- get results without scanning files

[Erick Erickson <er...@gmail.com>]

Please review:
http://wiki.apache.org/solr/UsingMailingLists

You haven't given us near enough information to answer your question.
My guess is you're trying to return very large data sets, something
Solr isn't designed to do, but that's only a guess.

Possibly you have not set lazy field loading to on.

Best
Erick

On Mon, Apr 29, 2013 at 8:26 AM, dafnashkedy <da...@yahoo.com> wrote:
> I would like to execute a solr query and get only the uniquKey I've defined.
> The documents are very big so defining fl='my_key' is not fast enough - all
> the matching documents are still scanned and the query can take hours (even
> though the search itself was fast - numFound takes few seconds to return).
> I should mention that all the data is stored, and creating a new index is
> not an option.
>
> One idea I had was to get the docIds of the results and map them to my_key
> in the code.
> I used fl=[docid], thinking it doesn't need scanning to get this info, but
> it still takes too long to return.
>
> Is there a better way to get the docIds?
> Or a way to unstore certain fields without reindexing?
> Or perhapse a compeletly different way to get the results without scanning
> all the fields?
>
> Thanks,
>
> Dafna
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/solr-query-get-results-without-scanning-files-tp4059798.html
> Sent from the Solr - User mailing list archive at Nabble.com.