You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2022/08/16 14:35:54 UTC
[GitHub] [cloudstack] gg4126 opened a new issue, #6647: Resume "download template" button under images/Templates/zones
gg4126 opened a new issue, #6647:
URL: https://github.com/apache/cloudstack/issues/6647
<!--
Verify first that your issue/request is not already reported on GitHub.
Also test if the latest release and main branch are affected too.
Always add information AFTER of these HTML comments, but no need to delete the comments.
-->
##### ISSUE TYPE
<!-- Pick one below and delete the rest -->
* Improvement Request
* Enhancement Request
##### COMPONENT NAME
<!--
Categorize the issue, e.g. API, VR, VPN, UI, etc.
-->
~~~
UI
~~~
##### CLOUDSTACK VERSION
<!--
New line separated list of affected versions, commit ID for issues on main branch.
-->
~~~
4.17.0.1
~~~
##### CONFIGURATION
<!--
Information about the configuration if relevant, e.g. basic network, advanced networking, etc. N/A otherwise
-->
Advanced Networking
##### OS / ENVIRONMENT
<!--
Information about the environment if relevant, N/A otherwise
-->
RHEL-7.9
##### SUMMARY
<!-- Explain the problem/feature briefly -->
While a template is being uploaded/pushed to a specific zone due to network issues the image/template was not fully downloaded onto that zone. Currently the download percentage is showing as 31%, and even though the management server was bounced yet the download is not getting completed and am looking for a button to resume the download but there is none.
##### STEPS TO REPRODUCE
<!--
For bugs, show exactly how to reproduce the problem, using a minimal test-case. Use Screenshots if accurate.
For new features, show how the feature would be used.
-->
<!-- Paste example playbooks or commands between quotes below -->
~~~
step1: Navigate to images/templates and click "Register template from URL"
step2: Fill-up the form to download the template to the desired zone and click OK
step3: While the template is being downloaded - due to network outages or the apache server where qcow2 templates are kept suddenly goes down this will interrupt the template downloading to a specific zone(s).
step4: Once the network outage is resolved, the user should be in a position to "resume download" on images/Templates/zones tab which is NOT available at the moment, hence creating this enhancement request
~~~
<!-- You can also paste gist.github.com links for larger files -->
##### EXPECTED RESULTS
<!-- What did you expect to happen when running the steps above? -->
~~~
As soon as the network issue is resolved, the user should be able to resume the template download by clicking "Resume Download" button.
~~~
##### ACTUAL RESULTS
<!-- What actually happened? -->
<!-- Paste verbatim command output between quotes below -->
~~~
there is no button to resume the template download;
~~~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] A button "resume download" is needed to finish-up template downloading under images/Templates/zones [cloudstack]
Posted by "davift (via GitHub)" <gi...@apache.org>.
davift commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-3141419636
@DaanHoogland ,
Just to clarify the solution that I proposed above: I did not test this because my Java skills are close to none.
I wrote it down based on the symptoms I’ve noticed:
- The download sometimes freezes and doesn’t recover quickly.
- It also doesn’t seem to retry if it fails.
@nvazquez is the best person to assess this, as it relates to his talk about "Bypass CloudStack Secondary Storage."
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] A button "resume download" is needed to finish-up template downloading under images/Templates/zones [cloudstack]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-4523869689
This issue is stale because it has been open for 120 days with no activity. It may be removed by administrators of this project at any time. Remove the stale label or comment to request for removal of it to prevent this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] gitsan13 commented on issue #6647: A button "resume download" is needed to finish-up template downloading under images/Templates/zones
Posted by GitBox <gi...@apache.org>.
gitsan13 commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-1239310444
I would like to contribute to this enhancement. Can you guide me through the process?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] A button "resume download" is needed to finish-up template downloading under images/Templates/zones [cloudstack]
Posted by "daviftorres (via GitHub)" <gi...@apache.org>.
daviftorres commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-3144757247
@nvazquez, the only reference to the download that I found in `/var/log/cloud.log` (SSVM) is the following line, which indicates that it has started, but there is nothing after that to show whether it succeeded or failed:
```
2025-08-01T02:26:24,986 INFO [storage.template.HttpTemplateDownloader] (AgentRequest-Handler-5:[]) No credentials configured for host=<redacted>:80
2025-08-01T02:26:25,088 INFO [storage.template.HttpTemplateDownloader] (pool-2-thread-4:[]) Starting download from http://<redacted>/images/windows/windows_11_pro-202508010000.qcow2 to /mnt/SecStorage/<redacted>/template/tmpl/4/401/dnld14596858942789915474tmp_ remoteSize=(18.93 GB) 20330577920 , max size=(50.00 GB) 53687091200
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] A button "resume download" is needed to finish-up template downloading under images/Templates/zones [cloudstack]
Posted by "daviftorres (via GitHub)" <gi...@apache.org>.
daviftorres commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-3140781750
I have reports from clients who tried to download a Template or ISO from a URL, but the download either hangs indefinitely or takes a very long time.
Because I have limited Java skills, I couldn’t confidently find the exact part of the code where the download happens. However, I found one section that I can use to explain my proposal:
<img width="1556" height="505" alt="Image" src="https://github.com/user-attachments/assets/2fcf785c-d6cb-419a-881a-ff15974dcb65" />
In this example, I try to prevent the download from hanging by adding a timeout when there’s no data stream for a certain period. I also added a retry mechanism with up to 3 attempts to handle the issue more gracefully.
In short, this is a problem I’ve seen happen multiple times.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] A button "resume download" is needed to finish-up template downloading under images/Templates/zones [cloudstack]
Posted by "DaanHoogland (via GitHub)" <gi...@apache.org>.
DaanHoogland commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-3143274716
> [@nvazquez](https://github.com/nvazquez) is the best person to assess this
He is certainly one of them ;) @shwstppr @harikrishna-patnala might have opinions as well ...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] gg4126 commented on issue #6647: A button "resume download" is needed to finish-up template downloading under images/Templates/zones
Posted by GitBox <gi...@apache.org>.
gg4126 commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-1217054936
[](url
)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] A button "resume download" is needed to finish-up template downloading under images/Templates/zones [cloudstack]
Posted by "nvazquez (via GitHub)" <gi...@apache.org>.
nvazquez commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-3179623268
Thanks @daviftorres sorry for the delay, yes it seems like the cases in which the error comes from the server are not properly covered. Will explore a solution based on your input
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] gg4126 commented on issue #6647: A button "resume download" is needed to finish-up template downloading under images/Templates/zones
Posted by GitBox <gi...@apache.org>.
gg4126 commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-1218394624
Thanks Rohit for your response! the alternate solution works, and we are good with it for now, but please consider having this button to resume the download if it is possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] A button "resume download" is needed to finish-up template downloading under images/Templates/zones [cloudstack]
Posted by "shwstppr (via GitHub)" <gi...@apache.org>.
shwstppr commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-3143477412
IMO, I see multiple issues here:
- The original improvement request may need introduction of a new API - reconcile/resumeTemplate, etc
- Issue and the solution shared in https://github.com/apache/cloudstack/issues/6647#issuecomment-3140781750 by @daviftorres looks fine a from high-level, though we might already have some configs for timeout values used. Also, we would need reproduction steps to implement and test this.
cc @DaanHoogland @davift
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] A button "resume download" is needed to finish-up template downloading under images/Templates/zones [cloudstack]
Posted by "nvazquez (via GitHub)" <gi...@apache.org>.
nvazquez commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-3144009407
Hi @davift @shwstppr - I think adding a retrying mechanism would be helpful but perhaps wouldn't prevent the issue entirely. I agree we could add a new API to manually trigger the resume (or maybe re-download) of a specific template when the issue persists.
@davift were you able to reproduce the issue manually to replicate the symptoms from the step 3? It would be useful for exploring a solution
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] A button "resume download" is needed to finish-up template downloading under images/Templates/zones [cloudstack]
Posted by "daviftorres (via GitHub)" <gi...@apache.org>.
daviftorres commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-3144705118
Yes, I do have one client who reported today the same issue described in "step 3" by the original author (who suspected a network failure or an issue on the HTTP server).
<img width="1493" height="270" alt="Image" src="https://github.com/user-attachments/assets/395c7aa8-3182-46b7-9a5d-9aea0fc00fcd" />
In this case, I confirmed the problem was indeed on the HTTP server side: the file failed to download from three different sources simultaneously, and I was also unable to download it manually.
On the SSVM, there's no visible activity from a Java application, and the download progress remains frozen at the same value, it doesn't timeout or retry.
<img width="714" height="387" alt="Image" src="https://github.com/user-attachments/assets/440fbd6c-51e6-410c-9d18-ff2ffa22205e" />
To test how the system handles recovery, I re-deployed the SSVM in one of the zones.
As expected, the system quickly detects that the SSVM is not up:
<img width="1058" height="222" alt="Image" src="https://github.com/user-attachments/assets/65e07476-60b0-4650-b52c-682fbc6003ab" />
However, the status provided does not indicate what it's about to do next:
<img width="1022" height="222" alt="Image" src="https://github.com/user-attachments/assets/357c7144-048b-4054-90c7-66741345b76e" />
Finally, it retries the download. As expected, this attempt also fails because the source is still unreachable. Yesterday, I had a similar scenario where the source was available, and the same procedure (re-deploying the SSVM) worked successfully.
<img width="1023" height="219" alt="Image" src="https://github.com/user-attachments/assets/9a2d18df-0fe6-4450-9841-a759268556e7" />
@nvazquez, does this clarify your question regarding "step 3"? I still have the SSVMs in the other two zones running, let me know if you’d like me to collect specific logs that could be helpful.
In summary: the goal here isn’t to fix a bug in the SSVM itself, but to improve its resilience against external failures and ensure it can fail gracefully if self-healing isn’t possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] gg4126 commented on issue #6647: A button "resume download" is needed to finish-up template downloading under images/Templates/zones
Posted by GitBox <gi...@apache.org>.
gg4126 commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-1239355789
@gitsan13,
Thanks for your interest on this enhancement, please get in touch with @rohityadavcloud - he can guide you thru...thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] rohityadavcloud commented on issue #6647: A button "resume download" is needed to finish-up template downloading under images/Templates/zones
Posted by GitBox <gi...@apache.org>.
rohityadavcloud commented on issue #6647:
URL: https://github.com/apache/cloudstack/issues/6647#issuecomment-1218009562
I think if you're uploading an ISO or template and something goes wrong with SSVM and mgmt server, it might loose track of it and you'll need to redo the upload (there's a timeout after which the upload will be marked as fail).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org