Chronological partitioning of data - what does Solr offer in this area?

[Gili Nachum <gi...@gmail.com>]

Hello!

*Does Solr support any sort of chronological ordering of data?*
I would like to divide my data to: Daily, weekly, monthly, yearly parts.
For performance sake.
Has anyone done something like this over SolrCloud?

More thoughts:
While Indexing: I'm soft committing every 2 seconds so I would rather do
that on the daily index only (open reader and cache invalidation effort) as
the total index shard size is >200GB
While Searching: I would rather search first the daily and weekly parts,
moving to older data only if results are not satisfying.

I guess there's a challenge to move the daily data to the weekly data at
the end of a day, and so on....
Anything build-in that goes in this direction? If not, any example of some
custom collection/sharding configuration?

Thanks.
Gili.

Re: Chronological partitioning of data - what does Solr offer in this area?

[Alexandre Rafalovitch <ar...@gmail.com>]

Have you looked at collection aliasing already?
http://www.anshumgupta.net/2013/10/collection-aliasing-in-solrcloud.html

Regards,
   Alex
Personal: http://www.outerthoughts.com/ and @arafalov
Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
Solr popularizers community: https://www.linkedin.com/groups?gid=6713853


On Tue, Sep 9, 2014 at 9:23 AM, Gili Nachum <gi...@gmail.com> wrote:
> Hello!
>
> *Does Solr support any sort of chronological ordering of data?*
> I would like to divide my data to: Daily, weekly, monthly, yearly parts.
> For performance sake.
> Has anyone done something like this over SolrCloud?
>
> More thoughts:
> While Indexing: I'm soft committing every 2 seconds so I would rather do
> that on the daily index only (open reader and cache invalidation effort) as
> the total index shard size is >200GB
> While Searching: I would rather search first the daily and weekly parts,
> moving to older data only if results are not satisfying.
>
> I guess there's a challenge to move the daily data to the weekly data at
> the end of a day, and so on....
> Anything build-in that goes in this direction? If not, any example of some
> custom collection/sharding configuration?
>
> Thanks.
> Gili.