You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Yago Riveiro (JIRA)" <ji...@apache.org> on 2016/07/26 16:25:20 UTC
[jira] [Comment Edited] (SOLR-6399) Implement unloadCollection in
the Collections API
[ https://issues.apache.org/jira/browse/SOLR-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394033#comment-15394033 ]
Yago Riveiro edited comment on SOLR-6399 at 7/26/16 4:24 PM:
-------------------------------------------------------------
With a flag in the core.properties saying that the core is not loaded on startup, a new state in zookeeper saying that collection is unloaded to not route queries and not trigger recoveries or notify that collection is down, and a command to load the collection on demand It's enough.
I don't want to do a backup with a restore, I want notify the cluster to not load data to memory to save resources, but if necessary loading the collection on the fly.
Backup data involve extra space somewhere, with 1T collection you needs 1T in other location to backup, to say nothing of transfer data over the network ...
Backup and restore is a nice feature, but in huge clusters with a lot of data you not always can do it without huge amount of resources.
was (Author: yriveiro):
With a flag in the core.properties saying that the core is not loaded on startup, a new state in zookeeper saying that collection is unloaded to not route queries and not trigger recoveries or notify that collection is down, and a command to load the collection on demand It's enough.
I don't want to do a backup with a restore, I want notify the cluster to not load data to memory to save resources, but if necessary loading the collection on the fly.
Backup data involve extra space somewhere, with 1T collection you needs 1T in other location to backup, to say nothing of transfer data over the network ...
> Implement unloadCollection in the Collections API
> -------------------------------------------------
>
> Key: SOLR-6399
> URL: https://issues.apache.org/jira/browse/SOLR-6399
> Project: Solr
> Issue Type: New Feature
> Reporter: dfdeshom
> Assignee: Shalin Shekhar Mangar
> Fix For: 6.0
>
>
> There is currently no way to unload a collection without deleting its contents. There should be a way in the collections API to unload a collection and reload it later, as needed.
> A use case for this is the following: you store logs by day, with each day having its own collection. You are required to store up to 2 years of data, which adds up to 730 collections. Most of the time, you'll want to have 3 days of data loaded for search. Having just 3 collections loaded into memory, instead of 730 will make managing Solr easier.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org