You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Hrishikesh Gadre (JIRA)" <ji...@apache.org> on 2016/05/02 23:07:12 UTC
[jira] [Commented] (SOLR-9055) Make collection backup/restore
extensible
[ https://issues.apache.org/jira/browse/SOLR-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267507#comment-15267507 ]
Hrishikesh Gadre commented on SOLR-9055:
----------------------------------------
>>I have a general question about HDFS; I have no real experience with it: I wonder if Java's NIO file abstractions could be used so we don't have to have separate code? If so it would be wonderful – simpler and less code to maintain. See https://github.com/damiencarol/jsr203-hadoop What do you think?
Although integrating HDFS and Java NIO API sounds interesting, I would prefer if it is directly provided by [HDFS client library|https://issues.apache.org/jira/browse/HADOOP-3518] as against a third party library which may/may not be supported in future. Also since Solr provides a HDFS backed Directory implementation, it probably make sense to reuse it.
However if we want to keep things simple, we can choose to not provide separate APIs to configure "repositories". Instead we can just pick the same file-system used to store the indexed data. That means in case of local file-system, the backup will be stored on shared file-system using SimpleFSDirectory implementation AND for HDFS we will use HdfsDirectory impl. Make sense?
> Make collection backup/restore extensible
> -----------------------------------------
>
> Key: SOLR-9055
> URL: https://issues.apache.org/jira/browse/SOLR-9055
> Project: Solr
> Issue Type: Task
> Reporter: Hrishikesh Gadre
> Attachments: SOLR-9055.patch
>
>
> SOLR-5750 implemented backup/restore API for Solr. This JIRA is to track the code cleanup/refactoring. Specifically following improvements should be made,
> - Add Solr/Lucene version to check the compatibility between the backup version and the version of Solr on which it is being restored.
> - Add a backup implementation version to check the compatibility between the "restore" implementation and backup format.
> - Introduce a Strategy interface to define how the Solr index data is backed up (e.g. using file copy approach).
> - Introduce a Repository interface to define the file-system used to store the backup data. (currently works only with local file system but can be extended). This should be enhanced to introduce support for "registering" repositories (e.g. HDFS, S3 etc.)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org