You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Fernando Guillén Camba <fe...@usc.es> on 2013/07/22 10:46:17 UTC
Error downloading VM volume.
Hi all.
I'm using CS4.1 with KVM and CentOS 6.4.
When trying to download a volume of a VM from the GUI everything seems
to go ok and I get to see a message with a download URL. But when trying
to use it I get the message:"The requested URL
/userdata/cd0f3ceb-5925-4641-bdcb-770f029275f8cow2 was not found on this
server."
Looking through the management server log I see (only relevant parts shown):
2013-07-22 09:13:39,512 DEBUG [cloud.api.ApiServlet]
(catalina-exec-1:null) ===START=== 172.16.243.144 -- GET
command=extractVolume&id=513cc283-1c70-404e-9811-0cd7d43ce1f3&zoneid=5bf
53e8f-3609-454f-a52d-18b9d4728971&mode=HTTP_DOWNLOAD&response=json&sessionkey=UG3l5gKLqW3U7UNcZIHJfiHyMcA%3D&_=1374477219497
2013-07-22 09:13:39,679 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-1:null) submit async job-264, details: AsyncJobVO
{id:264, userId: 4, accountId: 4, sessionKey: null, ins
tanceType: Volume, instanceId: 57, cmd:
org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd,
cmdOriginator: null, cmdInfo:
{"response":"json","id":"513cc283-1c70-404e-9811-0
cd7d43ce1f3","sessionkey":"UG3l5gKLqW3U7UNcZIHJfiHyMcA\u003d","ctxUserId":"4","zoneid":"5bf53e8f-3609-454f-a52d-18b9d4728971","_":"1374477219497","ctxAccountId":"4","ctxStartEventId":"
1051","mode":"HTTP_DOWNLOAD"}, cmdVersion: 0, callbackType: 0,
callbackAddress: null, status: 0, processStatus: 0, resultCode: 0,
result: null, initMsid: 90520736931003, completeMsid:
null, lastUpdated: null, lastPolled: null, created: null}
2013-07-22 09:13:39,680 DEBUG [cloud.api.ApiServlet]
(catalina-exec-1:null) ===END=== 172.16.243.144 -- GET
command=extractVolume&id=513cc283-1c70-404e-9811-0cd7d43ce1f3&zoneid=5bf53
e8f-3609-454f-a52d-18b9d4728971&mode=HTTP_DOWNLOAD&response=json&sessionkey=UG3l5gKLqW3U7UNcZIHJfiHyMcA%3D&_=1374477219497
2013-07-22 09:13:39,682 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-162:job-264) Executing
org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd for job-264
2013-07-22 09:13:39,783 DEBUG [cloud.user.AccountManagerImpl]
(Job-Executor-162:job-264) Access to Vol[57|vm=58|ROOT] granted to
Acct[4-roberto.rosende] by DomainChecker_EnhancerByClou
dStack_b7f3b020
2013-07-22 09:13:39,856 DEBUG [cloud.server.ManagementServerImpl]
(Job-Executor-162:job-264) Extract Mode - HTTP_DOWNLOAD
2013-07-22 09:13:39,867 DEBUG [agent.transport.Request]
(Job-Executor-162:job-264) Seq 6-1072845395: Sending { Cmd , MgmtId:
90520736931003, via: 6, Ver: v1, Flags: 100111, [{"storage
.CopyVolumeCommand":{"volumeId":57,"volumePath":"51ce38eb-0e91-4074-bdcb-33f7ad8deac0","pool":{"id":200,"uuid":"59c09500-1109-46a7-92e0-f3c4c2e71f0e","host":"localhost","path":"/mnt/pr
imario","port":0,"type":"SharedMountPoint"},"secondaryStorageURL":"nfs://192.168.0.6/export/secundario/usuarios","toSecondaryStorage":true,"wait":10800}}]
}
2013-07-22 09:14:58,031 DEBUG [agent.transport.Request]
(Job-Executor-162:job-264) Seq 10-1758535641: Sending { Cmd , MgmtId:
90520736931003, via: 10, Ver: v1, Flags: 100011,
[{"storage.CreateEntityDownloadURLCommand":{"installPath":"volumes/57/c3ff77b6-3fb8-4b96-b3ac-60257a5f80af.qcow2","parent":"0d0a2731-9ac8-3738-ac9a-aad3cdc5a40e","extractLinkUUID":"cd0f3ceb-5925-4641-bdcb-770f029275f8cow2","accountId":0,"wait":0}}]
}
2013-07-22 09:14:58,181 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-162:job-264) Complete async job-264, jobStatus: 1,
resultCode: 0, result:
org.apache.cloudstack.api.response.ExtractResponse@2d59283c
2013-07-22 09:14:58,252 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-162:job-264) Done executing
org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd for job-264
2013-07-22 09:14:58,900 DEBUG [agent.transport.Request]
(AgentManager-Handler-10:null) Seq 10-1758535641: Processing: { Ans: ,
MgmtId: 90520736931003, via: 10, Ver: v1, Flags: 10,
[{"storage.CreateEntityDownloadURLAnswer":{"resultString":"Error in
linking err=ln: creating symbolic link
`/var/www/html/userdata/cd0f3ceb-5925-4641-bdcb-770f029275f8cow2': No
space left on device","resultCode":0,"result":false,"wait":0}}] }
2013-07-22 09:14:58,900 DEBUG [agent.manager.AgentAttache]
(AgentManager-Handler-10:null) Seq 10-1758535641: Unable to find listener.
2013-07-22 09:14:58,900 INFO [agent.manager.ClusteredAgentManagerImpl]
(AgentManager-Handler-10:null) SeqA 10-1758535641: Response is not
processed: Seq 10-1758535641: { Ans: , MgmtId: 90520736931003, via: 10,
Ver: v1, Flags: 10,
[{"storage.CreateEntityDownloadURLAnswer":{"resultString":"Error in
linking err=ln: creating symbolic link
`/var/www/html/userdata/cd0f3ceb-5925-4641-bdcb-770f029275f8cow2': No
space left on device","resultCode":0,"result":false,"wait":0}}] }
What I get from that is thet the volume is correctly copied from primary
to secondary storage and the the creation of the download link fails.The
problem seems to be that there is no space left, but both my primary and
secondary storage have plenty of space left. And apart from this
everything else is working in my cloud: VMs, snapshots, consoles, ISOs,
templates, etc.
Any pointers of where to look next will be greatly appreciated.
Thanks.
--
Fernando Guillén Camba
Unidade de Xestión de Infraestruturas TIC
Centro de Investigación en Tecnoloxías da Información (CITIUS)
Teléfono: 8818 16409
Correo: citius.tic@usc.es
Re: Error downloading VM volume.
Posted by Fernando Guillén Camba <fe...@usc.es>.
Thx for the reply.
I logged into the SSVM and /dev/vda1 was full. It seems that the problem
was /var/log/cloud/cloud.out which at the moment was 1.5G big. I erased
it and the problem disappeared. After a reboot of the SSVM the log file
was created again although with a few kb size.
Now it seems quite obvious that I should have checked the SSVM but it
seems quite strange that a log file gets to use all the available disk
space.
¿Anyone has faced this problem?
El 22/07/13 12:01, Nitin Mehta escribió:
> Can you login into SSVM and check whether that has some space ?
>
> On 22/07/13 2:23 PM, "Fernando Guillén Camba" <fe...@usc.es>
> wrote:
>
>> Hi all.
>>
>> I'm using CS4.1 with KVM and CentOS 6.4.
>> When trying to download a volume of a VM from the GUI everything seems
>> to go ok and I get to see a message with a download URL. But when trying
>> to use it I get the message:"The requested URL
>> /userdata/cd0f3ceb-5925-4641-bdcb-770f029275f8cow2 was not found on this
>> server."
>>
>> Looking through the management server log I see (only relevant parts
>> shown):
>>
>> 2013-07-22 09:13:39,512 DEBUG [cloud.api.ApiServlet]
>> (catalina-exec-1:null) ===START=== 172.16.243.144 -- GET
>> command=extractVolume&id=513cc283-1c70-404e-9811-0cd7d43ce1f3&zoneid=5bf
>> 53e8f-3609-454f-a52d-18b9d4728971&mode=HTTP_DOWNLOAD&response=json&session
>> key=UG3l5gKLqW3U7UNcZIHJfiHyMcA%3D&_=1374477219497
>> 2013-07-22 09:13:39,679 DEBUG [cloud.async.AsyncJobManagerImpl]
>> (catalina-exec-1:null) submit async job-264, details: AsyncJobVO
>> {id:264, userId: 4, accountId: 4, sessionKey: null, ins
>> tanceType: Volume, instanceId: 57, cmd:
>> org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd,
>> cmdOriginator: null, cmdInfo:
>> {"response":"json","id":"513cc283-1c70-404e-9811-0
>> cd7d43ce1f3","sessionkey":"UG3l5gKLqW3U7UNcZIHJfiHyMcA\u003d","ctxUserId":
>> "4","zoneid":"5bf53e8f-3609-454f-a52d-18b9d4728971","_":"1374477219497","c
>> txAccountId":"4","ctxStartEventId":"
>> 1051","mode":"HTTP_DOWNLOAD"}, cmdVersion: 0, callbackType: 0,
>> callbackAddress: null, status: 0, processStatus: 0, resultCode: 0,
>> result: null, initMsid: 90520736931003, completeMsid:
>> null, lastUpdated: null, lastPolled: null, created: null}
>> 2013-07-22 09:13:39,680 DEBUG [cloud.api.ApiServlet]
>> (catalina-exec-1:null) ===END=== 172.16.243.144 -- GET
>> command=extractVolume&id=513cc283-1c70-404e-9811-0cd7d43ce1f3&zoneid=5bf53
>> e8f-3609-454f-a52d-18b9d4728971&mode=HTTP_DOWNLOAD&response=json&sessionke
>> y=UG3l5gKLqW3U7UNcZIHJfiHyMcA%3D&_=1374477219497
>> 2013-07-22 09:13:39,682 DEBUG [cloud.async.AsyncJobManagerImpl]
>> (Job-Executor-162:job-264) Executing
>> org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd for job-264
>> 2013-07-22 09:13:39,783 DEBUG [cloud.user.AccountManagerImpl]
>> (Job-Executor-162:job-264) Access to Vol[57|vm=58|ROOT] granted to
>> Acct[4-roberto.rosende] by DomainChecker_EnhancerByClou
>> dStack_b7f3b020
>> 2013-07-22 09:13:39,856 DEBUG [cloud.server.ManagementServerImpl]
>> (Job-Executor-162:job-264) Extract Mode - HTTP_DOWNLOAD
>> 2013-07-22 09:13:39,867 DEBUG [agent.transport.Request]
>> (Job-Executor-162:job-264) Seq 6-1072845395: Sending { Cmd , MgmtId:
>> 90520736931003, via: 6, Ver: v1, Flags: 100111, [{"storage
>> .CopyVolumeCommand":{"volumeId":57,"volumePath":"51ce38eb-0e91-4074-bdcb-3
>> 3f7ad8deac0","pool":{"id":200,"uuid":"59c09500-1109-46a7-92e0-f3c4c2e71f0e
>> ","host":"localhost","path":"/mnt/pr
>> imario","port":0,"type":"SharedMountPoint"},"secondaryStorageURL":"nfs://1
>> 92.168.0.6/export/secundario/usuarios","toSecondaryStorage":true,"wait":10
>> 800}}]
>> }
>>
>> 2013-07-22 09:14:58,031 DEBUG [agent.transport.Request]
>> (Job-Executor-162:job-264) Seq 10-1758535641: Sending { Cmd , MgmtId:
>> 90520736931003, via: 10, Ver: v1, Flags: 100011,
>> [{"storage.CreateEntityDownloadURLCommand":{"installPath":"volumes/57/c3ff
>> 77b6-3fb8-4b96-b3ac-60257a5f80af.qcow2","parent":"0d0a2731-9ac8-3738-ac9a-
>> aad3cdc5a40e","extractLinkUUID":"cd0f3ceb-5925-4641-bdcb-770f029275f8cow2"
>> ,"accountId":0,"wait":0}}]
>> }
>> 2013-07-22 09:14:58,181 DEBUG [cloud.async.AsyncJobManagerImpl]
>> (Job-Executor-162:job-264) Complete async job-264, jobStatus: 1,
>> resultCode: 0, result:
>> org.apache.cloudstack.api.response.ExtractResponse@2d59283c
>> 2013-07-22 09:14:58,252 DEBUG [cloud.async.AsyncJobManagerImpl]
>> (Job-Executor-162:job-264) Done executing
>> org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd for job-264
>> 2013-07-22 09:14:58,900 DEBUG [agent.transport.Request]
>> (AgentManager-Handler-10:null) Seq 10-1758535641: Processing: { Ans: ,
>> MgmtId: 90520736931003, via: 10, Ver: v1, Flags: 10,
>> [{"storage.CreateEntityDownloadURLAnswer":{"resultString":"Error in
>> linking err=ln: creating symbolic link
>> `/var/www/html/userdata/cd0f3ceb-5925-4641-bdcb-770f029275f8cow2': No
>> space left on device","resultCode":0,"result":false,"wait":0}}] }
>> 2013-07-22 09:14:58,900 DEBUG [agent.manager.AgentAttache]
>> (AgentManager-Handler-10:null) Seq 10-1758535641: Unable to find listener.
>> 2013-07-22 09:14:58,900 INFO [agent.manager.ClusteredAgentManagerImpl]
>> (AgentManager-Handler-10:null) SeqA 10-1758535641: Response is not
>> processed: Seq 10-1758535641: { Ans: , MgmtId: 90520736931003, via: 10,
>> Ver: v1, Flags: 10,
>> [{"storage.CreateEntityDownloadURLAnswer":{"resultString":"Error in
>> linking err=ln: creating symbolic link
>> `/var/www/html/userdata/cd0f3ceb-5925-4641-bdcb-770f029275f8cow2': No
>> space left on device","resultCode":0,"result":false,"wait":0}}] }
>>
>> What I get from that is thet the volume is correctly copied from primary
>> to secondary storage and the the creation of the download link fails.The
>> problem seems to be that there is no space left, but both my primary and
>> secondary storage have plenty of space left. And apart from this
>> everything else is working in my cloud: VMs, snapshots, consoles, ISOs,
>> templates, etc.
>>
>> Any pointers of where to look next will be greatly appreciated.
>> Thanks.
>>
>> --
>> Fernando Guillén Camba
>> Unidade de Xestión de Infraestruturas TIC
>> Centro de Investigación en Tecnoloxías da Información (CITIUS)
>> Teléfono: 8818 16409
>> Correo: citius.tic@usc.es
>>
>
--
Fernando Guillén Camba
Unidade de Xestión de Infraestruturas TIC
Centro de Investigación en Tecnoloxías da Información (CITIUS)
Teléfono: 8818 16409
Correo: citius.tic@usc.es
Re: Error downloading VM volume.
Posted by Nitin Mehta <Ni...@citrix.com>.
Can you login into SSVM and check whether that has some space ?
On 22/07/13 2:23 PM, "Fernando Guillén Camba" <fe...@usc.es>
wrote:
>Hi all.
>
>I'm using CS4.1 with KVM and CentOS 6.4.
>When trying to download a volume of a VM from the GUI everything seems
>to go ok and I get to see a message with a download URL. But when trying
>to use it I get the message:"The requested URL
>/userdata/cd0f3ceb-5925-4641-bdcb-770f029275f8cow2 was not found on this
>server."
>
>Looking through the management server log I see (only relevant parts
>shown):
>
>2013-07-22 09:13:39,512 DEBUG [cloud.api.ApiServlet]
>(catalina-exec-1:null) ===START=== 172.16.243.144 -- GET
>command=extractVolume&id=513cc283-1c70-404e-9811-0cd7d43ce1f3&zoneid=5bf
>53e8f-3609-454f-a52d-18b9d4728971&mode=HTTP_DOWNLOAD&response=json&session
>key=UG3l5gKLqW3U7UNcZIHJfiHyMcA%3D&_=1374477219497
>2013-07-22 09:13:39,679 DEBUG [cloud.async.AsyncJobManagerImpl]
>(catalina-exec-1:null) submit async job-264, details: AsyncJobVO
>{id:264, userId: 4, accountId: 4, sessionKey: null, ins
>tanceType: Volume, instanceId: 57, cmd:
>org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd,
>cmdOriginator: null, cmdInfo:
>{"response":"json","id":"513cc283-1c70-404e-9811-0
>cd7d43ce1f3","sessionkey":"UG3l5gKLqW3U7UNcZIHJfiHyMcA\u003d","ctxUserId":
>"4","zoneid":"5bf53e8f-3609-454f-a52d-18b9d4728971","_":"1374477219497","c
>txAccountId":"4","ctxStartEventId":"
>1051","mode":"HTTP_DOWNLOAD"}, cmdVersion: 0, callbackType: 0,
>callbackAddress: null, status: 0, processStatus: 0, resultCode: 0,
>result: null, initMsid: 90520736931003, completeMsid:
>null, lastUpdated: null, lastPolled: null, created: null}
>2013-07-22 09:13:39,680 DEBUG [cloud.api.ApiServlet]
>(catalina-exec-1:null) ===END=== 172.16.243.144 -- GET
>command=extractVolume&id=513cc283-1c70-404e-9811-0cd7d43ce1f3&zoneid=5bf53
>e8f-3609-454f-a52d-18b9d4728971&mode=HTTP_DOWNLOAD&response=json&sessionke
>y=UG3l5gKLqW3U7UNcZIHJfiHyMcA%3D&_=1374477219497
>2013-07-22 09:13:39,682 DEBUG [cloud.async.AsyncJobManagerImpl]
>(Job-Executor-162:job-264) Executing
>org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd for job-264
>2013-07-22 09:13:39,783 DEBUG [cloud.user.AccountManagerImpl]
>(Job-Executor-162:job-264) Access to Vol[57|vm=58|ROOT] granted to
>Acct[4-roberto.rosende] by DomainChecker_EnhancerByClou
>dStack_b7f3b020
>2013-07-22 09:13:39,856 DEBUG [cloud.server.ManagementServerImpl]
>(Job-Executor-162:job-264) Extract Mode - HTTP_DOWNLOAD
>2013-07-22 09:13:39,867 DEBUG [agent.transport.Request]
>(Job-Executor-162:job-264) Seq 6-1072845395: Sending { Cmd , MgmtId:
>90520736931003, via: 6, Ver: v1, Flags: 100111, [{"storage
>.CopyVolumeCommand":{"volumeId":57,"volumePath":"51ce38eb-0e91-4074-bdcb-3
>3f7ad8deac0","pool":{"id":200,"uuid":"59c09500-1109-46a7-92e0-f3c4c2e71f0e
>","host":"localhost","path":"/mnt/pr
>imario","port":0,"type":"SharedMountPoint"},"secondaryStorageURL":"nfs://1
>92.168.0.6/export/secundario/usuarios","toSecondaryStorage":true,"wait":10
>800}}]
>}
>
>2013-07-22 09:14:58,031 DEBUG [agent.transport.Request]
>(Job-Executor-162:job-264) Seq 10-1758535641: Sending { Cmd , MgmtId:
>90520736931003, via: 10, Ver: v1, Flags: 100011,
>[{"storage.CreateEntityDownloadURLCommand":{"installPath":"volumes/57/c3ff
>77b6-3fb8-4b96-b3ac-60257a5f80af.qcow2","parent":"0d0a2731-9ac8-3738-ac9a-
>aad3cdc5a40e","extractLinkUUID":"cd0f3ceb-5925-4641-bdcb-770f029275f8cow2"
>,"accountId":0,"wait":0}}]
>}
>2013-07-22 09:14:58,181 DEBUG [cloud.async.AsyncJobManagerImpl]
>(Job-Executor-162:job-264) Complete async job-264, jobStatus: 1,
>resultCode: 0, result:
>org.apache.cloudstack.api.response.ExtractResponse@2d59283c
>2013-07-22 09:14:58,252 DEBUG [cloud.async.AsyncJobManagerImpl]
>(Job-Executor-162:job-264) Done executing
>org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd for job-264
>2013-07-22 09:14:58,900 DEBUG [agent.transport.Request]
>(AgentManager-Handler-10:null) Seq 10-1758535641: Processing: { Ans: ,
>MgmtId: 90520736931003, via: 10, Ver: v1, Flags: 10,
>[{"storage.CreateEntityDownloadURLAnswer":{"resultString":"Error in
>linking err=ln: creating symbolic link
>`/var/www/html/userdata/cd0f3ceb-5925-4641-bdcb-770f029275f8cow2': No
>space left on device","resultCode":0,"result":false,"wait":0}}] }
>2013-07-22 09:14:58,900 DEBUG [agent.manager.AgentAttache]
>(AgentManager-Handler-10:null) Seq 10-1758535641: Unable to find listener.
>2013-07-22 09:14:58,900 INFO [agent.manager.ClusteredAgentManagerImpl]
>(AgentManager-Handler-10:null) SeqA 10-1758535641: Response is not
>processed: Seq 10-1758535641: { Ans: , MgmtId: 90520736931003, via: 10,
>Ver: v1, Flags: 10,
>[{"storage.CreateEntityDownloadURLAnswer":{"resultString":"Error in
>linking err=ln: creating symbolic link
>`/var/www/html/userdata/cd0f3ceb-5925-4641-bdcb-770f029275f8cow2': No
>space left on device","resultCode":0,"result":false,"wait":0}}] }
>
>What I get from that is thet the volume is correctly copied from primary
>to secondary storage and the the creation of the download link fails.The
>problem seems to be that there is no space left, but both my primary and
>secondary storage have plenty of space left. And apart from this
>everything else is working in my cloud: VMs, snapshots, consoles, ISOs,
>templates, etc.
>
>Any pointers of where to look next will be greatly appreciated.
>Thanks.
>
>--
>Fernando Guillén Camba
>Unidade de Xestión de Infraestruturas TIC
>Centro de Investigación en Tecnoloxías da Información (CITIUS)
>Teléfono: 8818 16409
>Correo: citius.tic@usc.es
>