[jira] [Created] (SOLR-15088) Backups should detect corruption during file upload

["Jason Gerlowski (Jira)" <ji...@apache.org>]

Jason Gerlowski created SOLR-15088:
--------------------------------------

             Summary: Backups should detect corruption during file upload
                 Key: SOLR-15088
                 URL: https://issues.apache.org/jira/browse/SOLR-15088
             Project: Solr
          Issue Type: Sub-task
      Security Level: Public (Default Security Level. Issues are Public)
            Reporter: Jason Gerlowski


Currently backups read and write files (either locally, or across a network), but nothing is done to make sure that a backup isn't backing up index files that are already corrupted.  Or to make sure that corruption doesn't occur in transit.  Backup/restore should ahve some protections to ensure that files that are already corrupted aren't persisted.  We can do this by computing a checksum of the file as it's being read/written and comparing that to values stored in the index files already.

See [SIP-12|https://cwiki.apache.org/confluence/display/SOLR/SIP-12%3A+Incremental+Backup+and+Restore] and the corresponding [discussion thread|http://mail-archives.apache.org/mod_mbox/lucene-dev/202012.mbox/%3cCAPCX2-LRxHMs55Mx249sSYLPWT-vb-fi=HifRoA12wiwLiSQMQ@mail.gmail.com%3e] for more details. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org