You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Christian Reuschling <ch...@gmail.com> on 2014/03/12 18:41:13 UTC

create a Filter/DocIdSet from a number of documents

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

I have a small set of document numbers as a query result collected with some non-scoring collector.

Now, I want to send high-performant successive queries only in this document number scope, as part
of a customized Similarity implementation (modified, dynamic idf on result query scope, known as
TF-ICF)

For this, after reading the user list and further looking around, I decided to try the approach
with a filter, i.e. IndexSearcher.search(Query, Filter, HitCountCollector), whereby the filter
should limit the scope to the initially determined document number list.

I have the hope that this will perform very well, because there is no need for reading information
that doesn't last in memory, as e.g. with a TermFrequenciesVector approach.

So far so good - but I can't find a nice way to create this Filter/DocIdSet easily out of my
simple document number list. I know it sounds trivial - what is it I can't see? :)

Thanks so much!

Christian
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlMgnDkACgkQ6EqMXq+WZg9h5wCeOHo3bfXW6G0wYTy0x1Vnvruc
AtQAn2e6oSniN/ZQ7g6nhUeyvM/QErJ9
=Wyja
-----END PGP SIGNATURE-----

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: create a Filter/DocIdSet from a number of documents

Posted by Michael McCandless <lu...@mikemccandless.com>.
Have a look at https://issues.apache.org/jira/browse/LUCENE-5489 ...
it's a patch to add a query "rescoring" API to do what you're
describing, I think.

Mike McCandless

http://blog.mikemccandless.com


On Wed, Mar 12, 2014 at 1:41 PM, Christian Reuschling
<ch...@gmail.com> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> I have a small set of document numbers as a query result collected with some non-scoring collector.
>
> Now, I want to send high-performant successive queries only in this document number scope, as part
> of a customized Similarity implementation (modified, dynamic idf on result query scope, known as
> TF-ICF)
>
> For this, after reading the user list and further looking around, I decided to try the approach
> with a filter, i.e. IndexSearcher.search(Query, Filter, HitCountCollector), whereby the filter
> should limit the scope to the initially determined document number list.
>
> I have the hope that this will perform very well, because there is no need for reading information
> that doesn't last in memory, as e.g. with a TermFrequenciesVector approach.
>
> So far so good - but I can't find a nice way to create this Filter/DocIdSet easily out of my
> simple document number list. I know it sounds trivial - what is it I can't see? :)
>
> Thanks so much!
>
> Christian
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.19 (GNU/Linux)
> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
>
> iEYEARECAAYFAlMgnDkACgkQ6EqMXq+WZg9h5wCeOHo3bfXW6G0wYTy0x1Vnvruc
> AtQAn2e6oSniN/ZQ7g6nhUeyvM/QErJ9
> =Wyja
> -----END PGP SIGNATURE-----
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org