You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Pooja Verlani <po...@gmail.com> on 2011/06/21 19:40:56 UTC
Removing duplicate field at the time of search
Hi,
I have a "X" field in my index, which is a feature hash I would like to use
to remove the duplicates in my result.
I cant keep this as the unique id field. Is there any method or any
parameter at the search time to remove the duplicates on a particular
field(hash in this case)?
Thanks in advance,
Regards,
Pooja
Re: Removing duplicate field at the time of search
Posted by Pooja Verlani <po...@gmail.com>.
I am fine to remove the duplicates and not show them up for this use case.
But grouping can also help me show one representative from the group.
At present I am using solr 1.4. Any idea how to achieve it otherwise if not
by using solr 3.3.
Regards,
Pooja
On Tue, Jun 21, 2011 at 11:55 PM, Erick Erickson <er...@gmail.com>wrote:
> Well, in trunk and the soon-to-be-released Solr 3.3, you could use
> grouping,
> what is the use-case here? Are you going to show all the docs (even
> duplicates)
> some of the time?
>
> Best
> Erick
>
> On Tue, Jun 21, 2011 at 1:53 PM, Pooja Verlani <po...@gmail.com>
> wrote:
> > Hi Eric,
> >
> > Thanks for the quick reply.
> > I had looked at the deduplication but I found it to deduplication at the
> > index time, right? I would prefer to do deduplication at the search time!
> >
> > Regards,
> > Pooja
> >
> > On Tue, Jun 21, 2011 at 11:15 PM, Erick Erickson <
> erickerickson@gmail.com>wrote:
> >
> >> I think this is what you're looking for:
> >> http://wiki.apache.org/solr/Deduplication
> >>
> >> Best
> >> Erick
> >>
> >> On Tue, Jun 21, 2011 at 1:40 PM, Pooja Verlani <pooja.verlani@gmail.com
> >
> >> wrote:
> >> > Hi,
> >> >
> >> > I have a "X" field in my index, which is a feature hash I would like
> to
> >> use
> >> > to remove the duplicates in my result.
> >> > I cant keep this as the unique id field. Is there any method or any
> >> > parameter at the search time to remove the duplicates on a particular
> >> > field(hash in this case)?
> >> >
> >> > Thanks in advance,
> >> >
> >> > Regards,
> >> > Pooja
> >> >
> >>
> >
>
Re: Removing duplicate field at the time of search
Posted by Erick Erickson <er...@gmail.com>.
Well, in trunk and the soon-to-be-released Solr 3.3, you could use grouping,
what is the use-case here? Are you going to show all the docs (even duplicates)
some of the time?
Best
Erick
On Tue, Jun 21, 2011 at 1:53 PM, Pooja Verlani <po...@gmail.com> wrote:
> Hi Eric,
>
> Thanks for the quick reply.
> I had looked at the deduplication but I found it to deduplication at the
> index time, right? I would prefer to do deduplication at the search time!
>
> Regards,
> Pooja
>
> On Tue, Jun 21, 2011 at 11:15 PM, Erick Erickson <er...@gmail.com>wrote:
>
>> I think this is what you're looking for:
>> http://wiki.apache.org/solr/Deduplication
>>
>> Best
>> Erick
>>
>> On Tue, Jun 21, 2011 at 1:40 PM, Pooja Verlani <po...@gmail.com>
>> wrote:
>> > Hi,
>> >
>> > I have a "X" field in my index, which is a feature hash I would like to
>> use
>> > to remove the duplicates in my result.
>> > I cant keep this as the unique id field. Is there any method or any
>> > parameter at the search time to remove the duplicates on a particular
>> > field(hash in this case)?
>> >
>> > Thanks in advance,
>> >
>> > Regards,
>> > Pooja
>> >
>>
>
Re: Removing duplicate field at the time of search
Posted by Pooja Verlani <po...@gmail.com>.
Hi Eric,
Thanks for the quick reply.
I had looked at the deduplication but I found it to deduplication at the
index time, right? I would prefer to do deduplication at the search time!
Regards,
Pooja
On Tue, Jun 21, 2011 at 11:15 PM, Erick Erickson <er...@gmail.com>wrote:
> I think this is what you're looking for:
> http://wiki.apache.org/solr/Deduplication
>
> Best
> Erick
>
> On Tue, Jun 21, 2011 at 1:40 PM, Pooja Verlani <po...@gmail.com>
> wrote:
> > Hi,
> >
> > I have a "X" field in my index, which is a feature hash I would like to
> use
> > to remove the duplicates in my result.
> > I cant keep this as the unique id field. Is there any method or any
> > parameter at the search time to remove the duplicates on a particular
> > field(hash in this case)?
> >
> > Thanks in advance,
> >
> > Regards,
> > Pooja
> >
>
Re: Removing duplicate field at the time of search
Posted by Erick Erickson <er...@gmail.com>.
I think this is what you're looking for:
http://wiki.apache.org/solr/Deduplication
Best
Erick
On Tue, Jun 21, 2011 at 1:40 PM, Pooja Verlani <po...@gmail.com> wrote:
> Hi,
>
> I have a "X" field in my index, which is a feature hash I would like to use
> to remove the duplicates in my result.
> I cant keep this as the unique id field. Is there any method or any
> parameter at the search time to remove the duplicates on a particular
> field(hash in this case)?
>
> Thanks in advance,
>
> Regards,
> Pooja
>