You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2022/04/04 12:10:15 UTC

[GitHub] [cloudstack] azmidhun opened a new issue, #6199: Volume Snapshot | Secondary storage mount issue|

azmidhun opened a new issue, #6199:
URL: https://github.com/apache/cloudstack/issues/6199

   <!--
   Verify first that your issue/request is not already reported on GitHub.
   Also test if the latest release and main branch are affected too.
   Always add information AFTER of these HTML comments, but no need to delete the comments.
   -->
   
   ##### ISSUE TYPE
   <!-- Pick one below and delete the rest -->
    * Bug Report
   
   
   ##### COMPONENT NAME
   <!--
   Categorize the issue, e.g. API, VR, VPN, UI, etc.
   -->
   ~~~
   mountNfsSecondaryStorage script
   ~~~
   
   ##### CLOUDSTACK VERSION
   <!--
   New line separated list of affected versions, commit ID for issues on main branch.
   -->
   
   ~~~
   4.16.1
   ~~~
   
   ##### CONFIGURATION
   <!--
   Information about the configuration if relevant, e.g. basic network, advanced networking, etc.  N/A otherwise
   -->
   
   Cloudstack 4.16.1, XCP-ng 8.2.1
   ##### OS / ENVIRONMENT
   <!--
   Information about the environment if relevant, N/A otherwise
   -->
   Centos7.9,  XCP-ng 8.2.1
   
   ##### SUMMARY
   <!-- Explain the problem/feature briefly -->
   
   Unable to take VM volume snapshot or Create new VM|| Secondary storage mount issue
   ##### STEPS TO REPRODUCE
   <!--
   For bugs, show exactly how to reproduce the problem, using a minimal test-case. Use Screenshots if accurate.
   
   For new features, show how the feature would be used.
   -->
   Storage>Volume>Take volume snapshot. 
   Sometimes create VM's not working. 
    I am getting the error as attached screenshot and while checking the logs we are getting below error
   P.S: I have verified that nfs server is working fine and secondary storage is mounted in xen server. Can someone point out the reason on this.
   <!-- Paste example playbooks or commands between quotes below -->
   ~~~
   ACS managment logs
   =================================
   
   2022-04-04 16:16:46,934 ERROR [o.a.c.a.c.u.s.CreateSnapshotCmd] (API-Job-Executor-28:ctx-361e0e2c job-101 ctx
   -38aba9ea) (logid:26068ccc) Failed to create snapshot due to an internal error creating snapshot for volume 9
   04a2153-67ce-4565-a12a-4b59faca0e73
   java.lang.RuntimeException: Unexpected exception
   
   Caused by: com.cloud.utils.exception.CloudRuntimeException: BackupSnapshot Failed due to Could not mount secondary storage 10.31.9.226:/storage/cloudstack/secondary/ on host /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3
           at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:301)
           at org.apache.cloudstack.storage.snapshot.DefaultSnapshotStrategy.backupSnapshot(DefaultSnapshotStrategy.java:171)
           at com.cloud.storage.snapshot.SnapshotManagerImpl.backupSnapshotToSecondary(SnapshotManagerImpl.java:1278)
           ... 45 more
   2022-04-04 16:16:46,937 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-28:ctx-361e0e2c job-101) (logid:26068ccc) Complete async job-101, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"Failed to create snapshot due to an internal error creating snapshot for volume 904a2153-67ce-4565-a12a-4b59faca0e73"}
   =================================
   
   
   
   /var/log/cloud/cloud.log
   =================================
   
   
   2022-04-04 15:48:51    DEBUG [root] Successfully mounted 10.31.9.226:/storage/cloudstack/secondary/ to /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3
   2022-04-04 15:48:51    DEBUG [root] #### CLOUD exit  mountNfsSecondaryStorage ####
   2022-04-04 15:48:52    DEBUG [root] #### CLOUD enter  makeDirectory ####
   2022-04-04 15:48:52    DEBUG [root] #### CLOUD exit  makeDirectory ####
   2022-04-04 15:48:52    DEBUG [root] #### CLOUD enter  mountNfsSecondaryStorage ####
   2022-04-04 15:48:52    DEBUG [root] Unexpected error while trying to mount 10.31.9.226:/storage/cloudstack/secondary/ to /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3
   2022-04-04 16:16:45    DEBUG [root] #### CLOUD enter  mountNfsSecondaryStorage ####
   2022-04-04 16:16:45    DEBUG [root] Unexpected error while trying to mount 10.31.9.226:/storage/cloudstack/secondary/ to /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3
   =================================
   
   
   xensource.log
   
   =================================
   Apr  4 16:16:45 xenserver-acs-1 xapi: [error||547180 ||backtrace] Async.host.call_plugin R:cb5d0a7171d5 failed with exception Server_error(XENAPI_PLUGIN_FAILURE, [ mountNfsSecondaryStorage; SROSError; Error reporting error, unknown key Unexpected error while trying to mount 10.31.9.226:/storage/cloudstack/secondary/ to /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3 ])
   Apr  4 16:16:45 xenserver-acs-1 xapi: [error||547180 ||backtrace] Raised Server_error(XENAPI_PLUGIN_FAILURE, [ mountNfsSecondaryStorage; SROSError; Error reporting error, unknown key Unexpected error while trying to mount 10.31.9.226:/storage/cloudstack/secondary/ to /var/cloud_mount/92ac41e2-5210-36ff-8d7b-97407b9fcfd3 ])
   Apr  4 16:16:45 xenserver-acs-1 xapi: [error||547180 ||backtrace] 1/1 xapi Raised at file (Thread 547180 has no backtrace table. Was with_backtraces called?, line 0
   Apr  4 16:16:45 xenserver-acs-1 xapi: [error||547180 ||backtrace]
   =================================
   
   ~~~
   
   <!-- You can also paste gist.github.com links for larger files -->
   
   ##### EXPECTED RESULTS
   <!-- What did you expect to happen when running the steps above? -->
   
   ~~~
   
   ~~~
   
   ##### ACTUAL RESULTS
   <!-- What actually happened? -->
   
   <!-- Paste verbatim command output between quotes below -->
   ~~
   ![Volume-snap error](https://user-images.githubusercontent.com/82935957/161540353-55a7de25-9ad0-410f-b8b2-b704c46971c7.png)
   ~
   Volume Snapshot Failed, VM Creation also getting failed sometimes
   
   ~~~
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [cloudstack] azmidhun commented on issue #6199: Volume Snapshot | Secondary storage mount issue|

Posted by GitBox <gi...@apache.org>.
azmidhun commented on issue #6199:
URL: https://github.com/apache/cloudstack/issues/6199#issuecomment-1091129205

   @all Providing a  NFS version in global setting 'secstorage.nfs.version' resolved the issue. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [cloudstack] sbrueseke commented on issue #6199: Volume Snapshot | Secondary storage mount issue|

Posted by GitBox <gi...@apache.org>.
sbrueseke commented on issue #6199:
URL: https://github.com/apache/cloudstack/issues/6199#issuecomment-1375923728

   It looks like this bug is still in 4.17.2.0. After the first time CS tells XCP-ng to mount the secondary storage it will not get unmounted again and next time CS wants XCP-ng to mount secondary storage fir any reason it runs into an error.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [cloudstack] azmidhun closed issue #6199: Volume Snapshot | Secondary storage mount issue|

Posted by GitBox <gi...@apache.org>.
azmidhun closed issue #6199: Volume Snapshot | Secondary storage mount issue|
URL: https://github.com/apache/cloudstack/issues/6199


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org