[GitHub] [solr-operator] cesarfm commented on issue #547: backup to GCS and S3 never completes

["cesarfm (via GitHub)" <gi...@apache.org>]

cesarfm commented on issue #547:
URL: https://github.com/apache/solr-operator/issues/547#issuecomment-1543802548

   Hello all. I am observing exactly the same symptoms described above.
   
   Moreover, I see something that might be of interest for the investigation. 
   - Let's say I have a GCS bucket called `mybucket`. After trying to run a backup, the files are created in the bucket as described by the OP. 
   - my SolrCloud is called `mycloud-solr`
   - my SolrBackup resource is called `mycloud-backup`, and I configured it with `location: mycloud-solr` (the location matches with the SolrCloud name, this is just a preference). So it's defined like:
   ```yaml
   apiVersion: solr.apache.org/v1beta1
   kind: SolrBackup
   metadata:
     name: mycloud-backup
     namespace: search
   spec:
     repositoryName: "gcs-backups"
     solrCloud: mycloud-solr
     location: "mycloud-solr"
     collections:
       - articles
   ```
   - the collection being backed up is called `articles`
   - then, I see that the actual backup files have the path `mycloud-solr/mycloud-backup-articles/articles` (so the path seems to be `{location}/{solrBackupName}-{collection}/{collection}`
   - Here is the thing: if I then connect to Solr and request:
   `http://localhost:8983/solr/admin/collections?action=LISTBACKUP&name=mycloud-backup-articles&location=mycloud-solr&repository=gcs-backups&gcsBucket=mybucket`, I do get the backups I created listed there, even if the SolrBackup CRD still reports itself as "in progress".
     - note that the `name=mycloud-backup-articles` corresponds to the path name directly under the location
   ```
   {
       "responseHeader": {
           "status": 0,
           "QTime": 347
       },
       "collection": "articles",
       "backups": [
           {
               "indexFileCount": 122,
               "indexSizeMB": 0.748,
               "shardBackupIds": {
                   "shard1": "md_shard1_0.json"
               },
               "collection.configName": "articles",
               "backupId": 0,
               "collectionAlias": "articles",
               "startTime": "2023-05-11T10:22:25.339652045Z",
               "indexVersion": "9.4.2",
               "endTime": "2023-05-11T10:22:42.946120826Z"
           },
           {
               "indexFileCount": 122,
               "indexSizeMB": 0.748,
               "shardBackupIds": {
                   "shard1": "md_shard1_1.json"
               },
               "collection.configName": "articles",
               "backupId": 1,
               "collectionAlias": "articles",
               "startTime": "2023-05-11T10:35:46.024110473Z",
               "indexVersion": "9.4.2",
               "endTime": "2023-05-11T10:35:50.499108324Z"
           }
       ]
   }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org