You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "Jason Gerlowski (Jira)" <ji...@apache.org> on 2021/01/26 20:52:00 UTC
[jira] [Comment Edited] (SOLR-15089) Allow backup/restoration to
Amazon's S3 blobstore
[ https://issues.apache.org/jira/browse/SOLR-15089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272412#comment-17272412 ]
Jason Gerlowski edited comment on SOLR-15089 at 1/26/21, 8:51 PM:
------------------------------------------------------------------
Thanks, it'll be awesome to get in! In terms of testing, I agree S3 mocks are a good way to go. Even if we can get some sort of cloud credits from INFRA, devs will still likely want something they can run anywhere to sanity check related changes.
I haven't done much looking into libraries yet though. Very interested if you have any suggestions for a particular library to stand in for real s3!
was (Author: gerlowskija):
Yeah, it'll be awesome to get in. In terms of testing, I agree S3 mocks are a good way to go. Even if we can get some sort of cloud credits from INFRA, devs will still likely want something they can run anywhere to sanity check related changes.
I haven't done much looking into libraries yet though. Very interested if you have any suggestions for a particular library to stand in for real s3!
> Allow backup/restoration to Amazon's S3 blobstore
> --------------------------------------------------
>
> Key: SOLR-15089
> URL: https://issues.apache.org/jira/browse/SOLR-15089
> Project: Solr
> Issue Type: Sub-task
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Jason Gerlowski
> Priority: Major
>
> Solr's BackupRepository interface provides an abstraction around the physical location/format that backups are stored in. This allows plugin writers to create "repositories" for a variety of storage mediums. It'd be nice if Solr offered more mediums out of the box though, such as some of the "blobstore" offerings provided by various cloud providers.
> This ticket proposes that a "BackupRepository" implementation for Amazon's popular 'S3' blobstore, so that Solr users can use it for backups without needing to write their own code.
> Amazon offers a s3 Java client with acceptable licensing, and the required code is relatively simple. The biggest challenge in supporting this will likely be procedural - integration testing requires S3 access and S3 access costs money. We can check with INFRA to see if there is any way to get cloud credits for an integration test to run in nightly Jenkins runs on the ASF Jenkins server. Alternatively we can try to stub out the blobstore in some reliable way.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org