Good strategy for news in Solr?

[Jon Baer <jo...@gmail.com>]

Ive spent a few months trying different techniques w/ regards to  
searching just news articles w/ players and can't seem to find the  
perfect setup.

Normally I take into consideration date (frequency + recently  
published), title (which boosts on relevancy) and general mm in body  
text (and score)

Sometimes its more of a preference on how to drill into news (own  
being most recently published) vs. historical where it can be more  
context based ...

Is anyone else toying w/ different setups for searching news in general?

- Jon

Re: Good strategy for news in Solr?

[Jon Baer <jo...@gmail.com>]

Yes, more or less, most of my tries have not been function query based  
just basic dismax handler stuff.  I have a bit of a unique case where  
Im dealing w/ last names + multiple players (think Staal ;-) and non  
tagged content (feeds) so it's a bit tricky than just news articles  
and some tend to overload stories w/ just names which don't pertain to  
the story context.

I have been trying on the side to do a "3-pass" phase where it's a  
normal index, then doc boost on date (ie yesterday's games) and then  
taking analytic reports and applying another boost.  I may end up w/  
another factor where if a user is signed in, the favorite team is also  
pushed as a document boost as well.  This all happens offline though +  
really wonder if this type of operation can / will ever reach realtime  
to some degree.  Id really like to find some time to develop the whole  
thing as more of a DIH plugin (post op).

Any other cool tips to try? :-)

- Jon

On Feb 19, 2009, at 8:20 AM, Grant Ingersoll wrote:

> Hey Jon,
>
> If I understand right, you want news about a particular player,  
> right?  And you need it to be fresh.
>
> Can you share more about what you've done so far?  It sounds like  
> you have tried out some function query stuff, but can you share what  
> you did there?
>
> -Grant
>
> On Feb 18, 2009, at 1:54 PM, Jon Baer wrote:
>
>> Ive spent a few months trying different techniques w/ regards to  
>> searching just news articles w/ players and can't seem to find the  
>> perfect setup.
>>
>> Normally I take into consideration date (frequency + recently  
>> published), title (which boosts on relevancy) and general mm in  
>> body text (and score)
>>
>> Sometimes its more of a preference on how to drill into news (own  
>> being most recently published) vs. historical where it can be more  
>> context based ...
>>
>> Is anyone else toying w/ different setups for searching news in  
>> general?
>>
>> - Jon
>
> --------------------------
> Grant Ingersoll
> http://www.lucidimagination.com/
>
> Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids)  
> using Solr/Lucene:
> http://www.lucidimagination.com/search
>

Re: Good strategy for news in Solr?

[Grant Ingersoll <gs...@apache.org>]

Hey Jon,

If I understand right, you want news about a particular player,  
right?  And you need it to be fresh.

Can you share more about what you've done so far?  It sounds like you  
have tried out some function query stuff, but can you share what you  
did there?

-Grant

On Feb 18, 2009, at 1:54 PM, Jon Baer wrote:

> Ive spent a few months trying different techniques w/ regards to  
> searching just news articles w/ players and can't seem to find the  
> perfect setup.
>
> Normally I take into consideration date (frequency + recently  
> published), title (which boosts on relevancy) and general mm in body  
> text (and score)
>
> Sometimes its more of a preference on how to drill into news (own  
> being most recently published) vs. historical where it can be more  
> context based ...
>
> Is anyone else toying w/ different setups for searching news in  
> general?
>
> - Jon

--------------------------
Grant Ingersoll
http://www.lucidimagination.com/

Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids)  
using Solr/Lucene:
http://www.lucidimagination.com/search