You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by "rajujith (via GitHub)" <gi...@apache.org> on 2024/04/29 11:22:50 UTC
[I] Default systemVM template is not downloaded to S3 secondary storage [cloudstack]
rajujith opened a new issue, #9002:
URL: https://github.com/apache/cloudstack/issues/9002
<!--
Verify first that your issue/request is not already reported on GitHub.
Also test if the latest release and main branch are affected too.
Always add information AFTER of these HTML comments, but no need to delete the comments.
-->
##### ISSUE TYPE
<!-- Pick one below and delete the rest -->
* Bug Report
##### COMPONENT NAME
<!--
Categorize the issue, e.g. API, VR, VPN, UI, etc.
-->
~~~
S3 Secondary storage, system VM template
~~~
##### CLOUDSTACK VERSION
<!--
New line separated list of affected versions, commit ID for issues on main branch.
-->
~~~
4.19 with PR #8986
~~~
##### CONFIGURATION
<!--
Information about the configuration if relevant, e.g. basic network, advanced networking, etc. N/A otherwise
-->
MinIO S3 bucket configured
NFS staging storage
##### SUMMARY
<!-- Explain the problem/feature briefly -->
Although the S3 secondary storage gets added with the fix in #8986 the default system VM template do not get downloaded. In the management server logs, I can see the _'DownloadProgressCommand'_ running but the file is not being downloaded. Note that the zone is created fresh and there is no SSVM to download the template. I am assuming there may be something missing to copy the systemVM template in the management server to the S3 bucket either via staging NFS or without it.
##### STEPS TO REPRODUCE
<!--
For bugs, show exactly how to reproduce the problem, using a minimal test-case. Use Screenshots if accurate.
For new features, show how the feature would be used.
-->
<!-- Paste example playbooks or commands between quotes below -->
~~~
1. Create a MinIO S3 bucket
2. Add a zone with S3 secondary storage and NFS staging storage using the above bucket.
3. Launch the zone and wait for the system VM template status to become 'Ready'
~~~
<!-- You can also paste gist.github.com links for larger files -->
##### EXPECTED RESULTS
<!-- What did you expect to happen when running the steps above? -->
~~~
SystemVM template is downloaded
~~~
##### ACTUAL RESULTS
<!-- What actually happened? -->
<!-- Paste verbatim command output between quotes below -->
~~~
SystemVM template is not downloaded
~~~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Default systemVM template is not downloaded to S3 secondary storage [cloudstack]
Posted by "DaanHoogland (via GitHub)" <gi...@apache.org>.
DaanHoogland commented on issue #9002:
URL: https://github.com/apache/cloudstack/issues/9002#issuecomment-2090327051
@swill @pdion891 can you say whether this is supposed to work? and how?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Default systemVM template is not downloaded to S3 secondary storage [cloudstack]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #9002:
URL: https://github.com/apache/cloudstack/issues/9002#issuecomment-5577805745
This issue is stale because it has been open for 120 days with no activity. It may be removed by administrators of this project at any time. Remove the stale label or comment to request for removal of it to prevent this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Default systemVM template is not downloaded to S3 secondary storage [cloudstack]
Posted by "gogast (via GitHub)" <gi...@apache.org>.
gogast commented on issue #9002:
URL: https://github.com/apache/cloudstack/issues/9002#issuecomment-2306794533
When last time I tried to setup s3 secondary storage with minio the problem was with adress format: request was going to https://bucket.endpoint but in minio it is https://endpoint/bucket
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Default systemVM template is not downloaded to S3 secondary storage [cloudstack]
Posted by "Damans227 (via GitHub)" <gi...@apache.org>.
Damans227 commented on issue #9002:
URL: https://github.com/apache/cloudstack/issues/9002#issuecomment-3745649085
I dug into this a bit. I set up a fresh 4.20.3 env with MinIO running on one of the management server VMs and configured an S3 bucket for secondary storage. The secondary storage gets created successfully, but the system VM never comes up.
In the logs I’m seeing this error: `System VM Template is not ready at zone [1], wait until it is ready to launch secondary storage VM`.
```
2026-01-13 17:47:53,998 DEBUG [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:[ctx-49a74801]) (logid:6b471c7c) System VM Template is not ready at zone [1], wait until it is ready to launch secondary storage VM.
2026-01-13 17:48:23,816 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:[ctx-839ca70c]) (logid:41b5066c) System vm template is not ready at data center Zone {"id": "1", "name": "ref-trl-10589-k-Mu22-daman-arora", "uuid": "9145ae72-431c-4e06-a4c5-ab259decf071"}, wait until it is ready to launch console proxy vm
2026-01-13 17:48:23,999 DEBUG [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:[ctx-8e791e0c]) (logid:78a53f93) System VM Template is not ready at zone [1], wait until it is ready to launch secondary storage VM.
2026-01-13 17:48:53,819 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:[ctx-c576cd8a]) (logid:8eb56943) System vm template is not ready at data center Zone {"id": "1", "name": "ref-trl-10589-k-Mu22-daman-arora", "uuid": "9145ae72-431c-4e06-a4c5-ab259decf071"}, wait until it is ready to launch console proxy vm
2026-01-13 17:48:54,000 DEBUG [o.a.c.s.PremiumSecondaryStorageManagerImpl] (secstorage-1:[ctx-84929584]) (logid:5dcc726d) System VM Template is not ready at zone [1], wait until it is ready to launch secondary storage VM.
darora@dell16plus:~$
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Default systemVM template is not downloaded to S3 secondary storage [cloudstack]
Posted by "rohityadavcloud (via GitHub)" <gi...@apache.org>.
rohityadavcloud commented on issue #9002:
URL: https://github.com/apache/cloudstack/issues/9002#issuecomment-2085363969
Worth checking if that's supported at all.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Default systemVM template is not downloaded to S3 secondary storage [cloudstack]
Posted by "Damans227 (via GitHub)" <gi...@apache.org>.
Damans227 commented on issue #9002:
URL: https://github.com/apache/cloudstack/issues/9002#issuecomment-3745676160
Interestingly, it looks like S3 can be used as secondary storage only when it’s region-scoped, not zone-scoped. Even though I tried to create a zone-scoped S3, it actually ended up being created as region-scoped.
<img width="1490" height="836" alt="Image" src="https://github.com/user-attachments/assets/77d354cf-5feb-4ad2-956d-201ded26da0b" />
[DefaultEndPointSelector.java line 409](https://github.com/apache/cloudstack/blob/main/engine/storage/src/main/java/org/apache/cloudstack/storage/endpoint/DefaultEndPointSelector.java#L409) — the bootstrap condition checks for ScopeType.ZONE but S3 is hardcoded to only support ScopeType.REGION in [S3ImageStoreProviderImpl.isScopeSupported()](https://github.com/apache/cloudstack/blob/main/plugins/storage/image/s3/src/main/java/org/apache/cloudstack/storage/datastore/provider/S3ImageStoreProviderImpl.java#L92-L96). The comment even says "for bootstrap system vm template downloading to region image store" but the code checks for ZONE - so the condition never matches for S3... which may be that's why the download of system VM template is never triggered?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org