You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Amit Das <am...@cloudbyte.com> on 2013/08/22 13:20:10 UTC

System VMs not running

Hi folks,

I am running CloudStack 4.1.1. & running the NFS share on the same box as
CloudStack management server (CentOS 6). The hypervisor is a separate Xen
server.

I am not able to get the system vms in a running state.
We had not downloaded the vhd-util initially but it has been downloaded
now. The management server has been restarted & appropriate rpcbind, nfs
services started. The configuration was redone from scratch. However, we
are stuck with below error always.

com.cloud.utils.exception.CloudRuntimeException: can't mount
10.10.171.155:/export/secondary/template/tmpl/1/1
to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a         at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.
copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)

..
2013-08-22 16:30:52,866 DEBUG [agent.transport.Request] (secstorage-1:null)
Seq 12-749863191: Executing:  { Cmd , MgmtId: 268749071320359, via: 12,
Ver: v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,"type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
10.10.171.155/export/primary","url":"nfs://
10.10.171.155/export/secondary/template/tmpl/1/1/","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
}

..
2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
(DirectAgent-244:null) Seq 12-749863191: Processing:  { Ans: , MgmtId:
268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"Catch
Exception com.cloud.utils.exception.CloudRuntimeException on
host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
10.10.171.155/export/secondary/template/tmpl/1/1/ due to
com.cloud.utils.exception.CloudRuntimeException: can't mount
10.10.171.155:/export/secondary/template/tmpl/1/1
to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-b1e639b9b05a","wait":0}}] }

Regards,
Amit
*CloudByte Inc.* <http://www.cloudbyte.com/>

Re: System VMs not running

Posted by Nitin Mehta <Ni...@citrix.com>.
Glad it helped. 
Donal my friend can you add this in your blog please :)

On 26/08/13 11:44 AM, "Amit Das" <am...@cloudbyte.com> wrote:

>Thanks Nitin. This helped.
>
>Setting the verbose mode & running the script manually showed me
>'Permission Denied' error on vhd-util file.
>
>I had to change the permission on vhd-util for things to work.
>
>Regards,
>Amit
>*CloudByte Inc.* <http://www.cloudbyte.com/>
>
>
>On Fri, Aug 23, 2013 at 3:56 PM, Nitin Mehta <Ni...@citrix.com>
>wrote:
>
>> Donal - nice blog.
>> One more thing you might want to add is that for these shell scripts you
>> can uncomment the set -x option in the scripts and run them yourself.
>> SmLog sometimes might not narrow down the issue but has the info about
>>the
>> script path and the arguments. Once you uncomment the set -x and run it
>> yourself you can see the verbose output of the run.
>> Or better just uncomment the set -x option in the script and rerun the
>> entire operation. You should see a verbose output :)
>>
>> Thanks,
>> -Nitin
>>
>> On 23/08/13 2:56 PM, "Amit Das" <am...@cloudbyte.com> wrote:
>>
>> >Thanks Donal for the site. It explains the issue pretty well.
>> >
>> >I had already gone through the SMLog by observing some already raised
>>jira
>> >tickets. However, did not understand much then.
>> >
>> >Now i can see some *difference *between the logs on your blog vs. the
>>ones
>> >in my XenServer.
>> >
>> >[28437] 2013-08-23 07:37:28.703267      #### VMOPS enter
>> > copy_vhd_from_secondarystorage ####
>> >[28437] 2013-08-23 07:37:28.703390      ['bash', '/opt/xensource/bin/*
>> >copy_vhd_from_secondarystorage.sh*', '10.10.171.155:*
>> >/export/secondary/template/tmpl/1/1/*',
>> >'b45c8c85-4e55-983c-cb16-4c2f2356951c',
>> >'cloud-ebed83d7-afde-4470-b867-312bad7c21c7']
>> >[28437] 2013-08-23 07:37:28.826465      SUCCESS
>> >[28437] 2013-08-23 07:37:28.826691      #### VMOPS exit
>> > copy_vhd_from_secondarystorage ####
>> >[28463] 2013-08-23 07:37:29.787555      #### VMOPS enter
>> >kill_copy_process
>> >####
>> >[28463] 2013-08-23 07:37:29.787680      ['bash',
>> >'/opt/xensource/bin/kill_copy_process.sh', '']
>> >[28463] 2013-08-23 07:37:29.800439      SUCCESS
>> >[28463] 2013-08-23 07:37:29.800565      #### VMOPS exit
>>kill_copy_process
>> >####
>> >
>> >The difference that I find here is the .vhd template is never
>>mentioned in
>> >the copy_vhd_from_secondarystorage.sh
>> >Not sure if logic has changed.
>> >
>> >
>> >Regards,
>> >Amit
>> >*CloudByte Inc.* <http://www.cloudbyte.com/>
>> >
>> >
>> >On Fri, Aug 23, 2013 at 1:59 PM, Donal Lafferty
>> ><do...@citrix.com>wrote:
>> >
>> >> HI Amit,
>> >>
>> >> Still having problems?
>> >>
>> >> Probably time to have a look at the logs on XenServer.  There's a
>>guide
>> >>
>> >>
>> 
>>http://dlafferty.blogspot.co.uk/2013/08/using-cloudstacks-log-files-xense
>> >>rver.html
>> >>
>> >> DL
>> >>
>> >> > -----Original Message-----
>> >> > From: Amit Das [mailto:amit.das@cloudbyte.com]
>> >> > Sent: 23 August 2013 05:52
>> >> > To: dev@cloudstack.apache.org; aemneina@gmail.com
>> >> > Subject: Re: System VMs not running
>> >> >
>> >> > Yes. The step was missed.
>> >> >
>> >> > However, i tried out the steps on 'vhd_util' later & restarted nfs,
>> >> rpcbind &
>> >> > management services.
>> >> >
>> >> > Do i need to reset the DB as well ?
>> >> >
>> >> > Is there any work around for this ?
>> >> >
>> >> > Regards,
>> >> > Amit
>> >> > *CloudByte Inc.* <http://www.cloudbyte.com/>
>> >> >
>> >> >
>> >> > On Fri, Aug 23, 2013 at 9:56 AM, Ahmad Emneina <ae...@gmail.com>
>> >> > wrote:
>> >> >
>> >> > > this usually indicates that you missed the step where you prep
>> >> > > vhd-util on the hypervisor.
>> >> > >
>> >> > >
>> >> > > On Thu, Aug 22, 2013 at 9:18 PM, Amit Das
>><am...@cloudbyte.com>
>> >> > wrote:
>> >> > >
>> >> > > > The step worked fine after seeding system VM into secondary
>> >>storage
>> >> > > > location.
>> >> > > >
>> >> > > > However, i see the next error:
>> >> > > >
>> >> > > > WARN  [xen.resource.CitrixResourceBase] (DirectAgent-446:)
>>Catch
>> >> > > Exception
>> >> > > > com.cloud.utils.exception.CloudRuntimeException on
>> >> > > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
>> >> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
>> >> > > > com.cloud.utils.exception.CloudRuntimeException: *can not
>>create
>> >>vdi
>> >> > > > in
>> >> > > sr
>> >> > > > *
>> >> > > > b45c8c85-4e55-983c-cb16-4c2f2356951c
>> >> > > > com.cloud.utils.exception.CloudRuntimeException: can not create
>> >>vdi
>> >> > > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c
>> >> > > >         at
>> >> > > >
>> >> > > >
>> >> > >
>> >> > 
>>com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_sec
>> >> > > ondarystorage(CitrixResourceBase.java:2707)
>> >> > > >
>> >> > > > ...
>> >> > > >
>> >> > > > 2013-08-23 09:46:12,815 DEBUG [agent.transport.Request]
>> >> > > (secstorage-1:null)
>> >> > > > Seq 12-90517578: Sending  { Cmd , MgmtId: 268749071320359, via:
>> >>12,
>> >> Ver:
>> >> > > > v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
>> >> > > >
>> >> > > >
>> >> > >
>> >>":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolUuid":
>> >> > >
>> >>"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolId":211,"primaryPool":{"id
>> >> > >
>> >>":211,"uuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","host":"10.10.171.
>> >> > >
>> >>155","path":"/export/primary","port":2049,"type":"NetworkFilesystem"},
>> >> > > "secondaryStorageUrl":"nfs://
>> >> > > > 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
>> >> > > > 10.10.171.155/export/primary","url":"nfs://
>> >> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/
>> >> > > > 
>>","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
>> >> > > > }
>> >> > > >
>> >> > > > ...
>> >> > > >
>> >> > > > 2013-08-23 09:46:15,077 DEBUG [agent.transport.Request]
>> >> > > > (DirectAgent-72:null) Seq 12-90517578: Processing:  { Ans: ,
>> >>MgmtId:
>> >> > > > 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
>> >> > > >
>> >> > > >
>> >> > >
>> >>PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"detai
>> >> > > ls":"Catch
>> >> > > > Exception com.cloud.utils.exception.CloudRuntimeException on
>> >> > > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
>> >> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
>> >> > > > com.cloud.utils.exception.CloudRuntimeException: can not create
>> >>vdi
>> >> > > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c","wait":0}}] }
>> >> > > >
>> >> > > > Have i missed any other step for configuring primary &
>>secondary
>> >> > storage.
>> >> > > >
>> >> > > > Regards,
>> >> > > > Amit
>> >> > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
>> >> > > >
>> >> > > >
>> >> > > > On Thu, Aug 22, 2013 at 5:24 PM, Harikrishna Patnala <
>> >> > > > harikrishna.patnala@citrix.com> wrote:
>> >> > > >
>> >> > > > > Please follow the link to seed the system template
>> >> > > > >
>> >> > > >
>> >> > > http://cloudstack.apache.org/docs/en-
>> >> > US/Apache_CloudStack/4.1.1/html/I
>> >> > >
>> >>nstallation_Guide/management-server-install-flow.html#prepare-system-
>> >> > v
>> >> > > m-template
>> >> > > > >
>> >> > > > > -Harikrishna
>> >> > > > > On 22-Aug-2013, at 5:08 PM, Amit Das <am...@cloudbyte.com>
>> >> > > > >  wrote:
>> >> > > > >
>> >> > > > > > Hi,
>> >> > > > > >
>> >> > > > > > I have not seeded the secondary storage with system vm
>> >>template.
>> >> > > > > >
>> >> > > > > > The directory ../template/tmpl/1/1 is not present.
>> >> > > > > >
>> >> > > > > >
>> >> > > > > > Regards,
>> >> > > > > > Amit
>> >> > > > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
>> >> > > > > >
>> >> > > > > >
>> >> > > > > > On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <
>> >> > > > devdeep.singh@citrix.com
>> >> > > > > >wrote:
>> >> > > > > >
>> >> > > > > >> Did you seed the secondary storage with the systemvm
>>template
>> >> > > > > >> before starting the setup? If not, can you check if under
>> >>your
>> >> > > > > >> secondary
>> >> > > > > storage
>> >> > > > > >> the ../template/tmpl/1/1 directory is present?
>> >> > > > > >>
>> >> > > > > >> Regards,
>> >> > > > > >> Devdeep
>> >> > > > > >>
>> >> > > > > >>> -----Original Message-----
>> >> > > > > >>> From: Amit Das [mailto:amit.das@cloudbyte.com]
>> >> > > > > >>> Sent: Thursday, August 22, 2013 4:50 PM
>> >> > > > > >>> To: dev@cloudstack.apache.org
>> >> > > > > >>> Subject: System VMs not running
>> >> > > > > >>>
>> >> > > > > >>> Hi folks,
>> >> > > > > >>>
>> >> > > > > >>> I am running CloudStack 4.1.1. & running the NFS share on
>> >>the
>> >> > > > > >>> same
>> >> > > > box
>> >> > > > > as
>> >> > > > > >>> CloudStack management server (CentOS 6). The hypervisor
>>is a
>> >> > > separate
>> >> > > > > Xen
>> >> > > > > >>> server.
>> >> > > > > >>>
>> >> > > > > >>> I am not able to get the system vms in a running state.
>> >> > > > > >>> We had not downloaded the vhd-util initially but it has
>>been
>> >> > > > downloaded
>> >> > > > > >> now.
>> >> > > > > >>> The management server has been restarted & appropriate
>> >> > > > > >>> rpcbind, nfs services started. The configuration was
>>redone
>> >> from
>> >> > scratch.
>> >> > > However,
>> >> > > > > we
>> >> > > > > >> are
>> >> > > > > >>> stuck with below error always.
>> >> > > > > >>>
>> >> > > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't
>>mount
>> >> > > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
>> >> > > > > >>> to
>>/var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a
>> >> > > > at
>> >> > > > > >>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
>> >> > > > > >>> 
>>copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
>> >> > > > > >>>
>> >> > > > > >>> ..
>> >> > > > > >>> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request]
>> >> > > (secstorage-
>> >> > > > > >>> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId:
>> >> > > > 268749071320359,
>> >> > > > > >>> via: 12,
>> >> > > > > >>> Ver: v1, Flags: 100111,
>> >> > > > > >>> [{"storage.*PrimaryStorageDownloadCommand*
>> >> > > > > >>> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
>> >> > > > > >>> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
>> >> > > > > >>>
>> >> > > > >
>> >> > >
>> >>74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8
>> >> > > ae-
>> >> > > > > >>> 32bb-94e1-
>> >> > > > > >>>
>> >> > > > > >>
>> >> > > > >
>> >> > > >
>> >> > >
>> >>74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2
>> >> > > 049,
>> >> > > > > >>> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
>> >> > > > > >>> 
>>10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
>> >> > > > > >>> 10.10.171.155/export/primary","url":"nfs://
>> >> > > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/
>> >> > > > > ","format":"VHD","acco
>> >> > > > > >>> untId":1,"name":"routing-1","wait":10800}}]
>> >> > > > > >>> }
>> >> > > > > >>>
>> >> > > > > >>> ..
>> >> > > > > >>> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
>> >> > > > > >>> (DirectAgent-244:null) Seq 12-749863191: Processing:  {
>> >>Ans: ,
>> >> > > > MgmtId:
>> >> > > > > >>> 268749071320359, via: 12, Ver: v1, Flags: 110,
>>[{"storage.*
>> >> > > > > >>>
>> >> > > > > >>
>> >> > > > >
>> >> > > >
>> >> > >
>> >> >
>> 
>>>>PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"detail
>>>>s"
>> >> > :"
>> >> > > > > >>> Catch
>> >> > > > > >>> Exception
>>com.cloud.utils.exception.CloudRuntimeException on
>> >> > > > > >>> host:21318624-cfd9-412d-aeb4-b1418424f287 for template:
>> >>nfs://
>> >> > > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
>> >> > > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't
>>mount
>> >> > > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
>> >> > > > > >>> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
>> >> > > > > >>> b1e639b9b05a","wait":0}}] }
>> >> > > > > >>>
>> >> > > > > >>> Regards,
>> >> > > > > >>> Amit
>> >> > > > > >>> *CloudByte Inc.* <http://www.cloudbyte.com/>
>> >> > > > > >>
>> >> > > > >
>> >> > > > >
>> >> > > >
>> >> > >
>> >>
>>
>>


Re: System VMs not running

Posted by Amit Das <am...@cloudbyte.com>.
Thanks Nitin. This helped.

Setting the verbose mode & running the script manually showed me
'Permission Denied' error on vhd-util file.

I had to change the permission on vhd-util for things to work.

Regards,
Amit
*CloudByte Inc.* <http://www.cloudbyte.com/>


On Fri, Aug 23, 2013 at 3:56 PM, Nitin Mehta <Ni...@citrix.com> wrote:

> Donal - nice blog.
> One more thing you might want to add is that for these shell scripts you
> can uncomment the set -x option in the scripts and run them yourself.
> SmLog sometimes might not narrow down the issue but has the info about the
> script path and the arguments. Once you uncomment the set -x and run it
> yourself you can see the verbose output of the run.
> Or better just uncomment the set -x option in the script and rerun the
> entire operation. You should see a verbose output :)
>
> Thanks,
> -Nitin
>
> On 23/08/13 2:56 PM, "Amit Das" <am...@cloudbyte.com> wrote:
>
> >Thanks Donal for the site. It explains the issue pretty well.
> >
> >I had already gone through the SMLog by observing some already raised jira
> >tickets. However, did not understand much then.
> >
> >Now i can see some *difference *between the logs on your blog vs. the ones
> >in my XenServer.
> >
> >[28437] 2013-08-23 07:37:28.703267      #### VMOPS enter
> > copy_vhd_from_secondarystorage ####
> >[28437] 2013-08-23 07:37:28.703390      ['bash', '/opt/xensource/bin/*
> >copy_vhd_from_secondarystorage.sh*', '10.10.171.155:*
> >/export/secondary/template/tmpl/1/1/*',
> >'b45c8c85-4e55-983c-cb16-4c2f2356951c',
> >'cloud-ebed83d7-afde-4470-b867-312bad7c21c7']
> >[28437] 2013-08-23 07:37:28.826465      SUCCESS
> >[28437] 2013-08-23 07:37:28.826691      #### VMOPS exit
> > copy_vhd_from_secondarystorage ####
> >[28463] 2013-08-23 07:37:29.787555      #### VMOPS enter
> >kill_copy_process
> >####
> >[28463] 2013-08-23 07:37:29.787680      ['bash',
> >'/opt/xensource/bin/kill_copy_process.sh', '']
> >[28463] 2013-08-23 07:37:29.800439      SUCCESS
> >[28463] 2013-08-23 07:37:29.800565      #### VMOPS exit  kill_copy_process
> >####
> >
> >The difference that I find here is the .vhd template is never mentioned in
> >the copy_vhd_from_secondarystorage.sh
> >Not sure if logic has changed.
> >
> >
> >Regards,
> >Amit
> >*CloudByte Inc.* <http://www.cloudbyte.com/>
> >
> >
> >On Fri, Aug 23, 2013 at 1:59 PM, Donal Lafferty
> ><do...@citrix.com>wrote:
> >
> >> HI Amit,
> >>
> >> Still having problems?
> >>
> >> Probably time to have a look at the logs on XenServer.  There's a guide
> >>
> >>
> http://dlafferty.blogspot.co.uk/2013/08/using-cloudstacks-log-files-xense
> >>rver.html
> >>
> >> DL
> >>
> >> > -----Original Message-----
> >> > From: Amit Das [mailto:amit.das@cloudbyte.com]
> >> > Sent: 23 August 2013 05:52
> >> > To: dev@cloudstack.apache.org; aemneina@gmail.com
> >> > Subject: Re: System VMs not running
> >> >
> >> > Yes. The step was missed.
> >> >
> >> > However, i tried out the steps on 'vhd_util' later & restarted nfs,
> >> rpcbind &
> >> > management services.
> >> >
> >> > Do i need to reset the DB as well ?
> >> >
> >> > Is there any work around for this ?
> >> >
> >> > Regards,
> >> > Amit
> >> > *CloudByte Inc.* <http://www.cloudbyte.com/>
> >> >
> >> >
> >> > On Fri, Aug 23, 2013 at 9:56 AM, Ahmad Emneina <ae...@gmail.com>
> >> > wrote:
> >> >
> >> > > this usually indicates that you missed the step where you prep
> >> > > vhd-util on the hypervisor.
> >> > >
> >> > >
> >> > > On Thu, Aug 22, 2013 at 9:18 PM, Amit Das <am...@cloudbyte.com>
> >> > wrote:
> >> > >
> >> > > > The step worked fine after seeding system VM into secondary
> >>storage
> >> > > > location.
> >> > > >
> >> > > > However, i see the next error:
> >> > > >
> >> > > > WARN  [xen.resource.CitrixResourceBase] (DirectAgent-446:) Catch
> >> > > Exception
> >> > > > com.cloud.utils.exception.CloudRuntimeException on
> >> > > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> >> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> >> > > > com.cloud.utils.exception.CloudRuntimeException: *can not create
> >>vdi
> >> > > > in
> >> > > sr
> >> > > > *
> >> > > > b45c8c85-4e55-983c-cb16-4c2f2356951c
> >> > > > com.cloud.utils.exception.CloudRuntimeException: can not create
> >>vdi
> >> > > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c
> >> > > >         at
> >> > > >
> >> > > >
> >> > >
> >> > com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_sec
> >> > > ondarystorage(CitrixResourceBase.java:2707)
> >> > > >
> >> > > > ...
> >> > > >
> >> > > > 2013-08-23 09:46:12,815 DEBUG [agent.transport.Request]
> >> > > (secstorage-1:null)
> >> > > > Seq 12-90517578: Sending  { Cmd , MgmtId: 268749071320359, via:
> >>12,
> >> Ver:
> >> > > > v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
> >> > > >
> >> > > >
> >> > >
> >>":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolUuid":
> >> > >
> >>"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolId":211,"primaryPool":{"id
> >> > >
> >>":211,"uuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","host":"10.10.171.
> >> > >
> >>155","path":"/export/primary","port":2049,"type":"NetworkFilesystem"},
> >> > > "secondaryStorageUrl":"nfs://
> >> > > > 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> >> > > > 10.10.171.155/export/primary","url":"nfs://
> >> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/
> >> > > > ","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
> >> > > > }
> >> > > >
> >> > > > ...
> >> > > >
> >> > > > 2013-08-23 09:46:15,077 DEBUG [agent.transport.Request]
> >> > > > (DirectAgent-72:null) Seq 12-90517578: Processing:  { Ans: ,
> >>MgmtId:
> >> > > > 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> >> > > >
> >> > > >
> >> > >
> >>PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"detai
> >> > > ls":"Catch
> >> > > > Exception com.cloud.utils.exception.CloudRuntimeException on
> >> > > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> >> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> >> > > > com.cloud.utils.exception.CloudRuntimeException: can not create
> >>vdi
> >> > > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c","wait":0}}] }
> >> > > >
> >> > > > Have i missed any other step for configuring primary & secondary
> >> > storage.
> >> > > >
> >> > > > Regards,
> >> > > > Amit
> >> > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
> >> > > >
> >> > > >
> >> > > > On Thu, Aug 22, 2013 at 5:24 PM, Harikrishna Patnala <
> >> > > > harikrishna.patnala@citrix.com> wrote:
> >> > > >
> >> > > > > Please follow the link to seed the system template
> >> > > > >
> >> > > >
> >> > > http://cloudstack.apache.org/docs/en-
> >> > US/Apache_CloudStack/4.1.1/html/I
> >> > >
> >>nstallation_Guide/management-server-install-flow.html#prepare-system-
> >> > v
> >> > > m-template
> >> > > > >
> >> > > > > -Harikrishna
> >> > > > > On 22-Aug-2013, at 5:08 PM, Amit Das <am...@cloudbyte.com>
> >> > > > >  wrote:
> >> > > > >
> >> > > > > > Hi,
> >> > > > > >
> >> > > > > > I have not seeded the secondary storage with system vm
> >>template.
> >> > > > > >
> >> > > > > > The directory ../template/tmpl/1/1 is not present.
> >> > > > > >
> >> > > > > >
> >> > > > > > Regards,
> >> > > > > > Amit
> >> > > > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
> >> > > > > >
> >> > > > > >
> >> > > > > > On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <
> >> > > > devdeep.singh@citrix.com
> >> > > > > >wrote:
> >> > > > > >
> >> > > > > >> Did you seed the secondary storage with the systemvm template
> >> > > > > >> before starting the setup? If not, can you check if under
> >>your
> >> > > > > >> secondary
> >> > > > > storage
> >> > > > > >> the ../template/tmpl/1/1 directory is present?
> >> > > > > >>
> >> > > > > >> Regards,
> >> > > > > >> Devdeep
> >> > > > > >>
> >> > > > > >>> -----Original Message-----
> >> > > > > >>> From: Amit Das [mailto:amit.das@cloudbyte.com]
> >> > > > > >>> Sent: Thursday, August 22, 2013 4:50 PM
> >> > > > > >>> To: dev@cloudstack.apache.org
> >> > > > > >>> Subject: System VMs not running
> >> > > > > >>>
> >> > > > > >>> Hi folks,
> >> > > > > >>>
> >> > > > > >>> I am running CloudStack 4.1.1. & running the NFS share on
> >>the
> >> > > > > >>> same
> >> > > > box
> >> > > > > as
> >> > > > > >>> CloudStack management server (CentOS 6). The hypervisor is a
> >> > > separate
> >> > > > > Xen
> >> > > > > >>> server.
> >> > > > > >>>
> >> > > > > >>> I am not able to get the system vms in a running state.
> >> > > > > >>> We had not downloaded the vhd-util initially but it has been
> >> > > > downloaded
> >> > > > > >> now.
> >> > > > > >>> The management server has been restarted & appropriate
> >> > > > > >>> rpcbind, nfs services started. The configuration was redone
> >> from
> >> > scratch.
> >> > > However,
> >> > > > > we
> >> > > > > >> are
> >> > > > > >>> stuck with below error always.
> >> > > > > >>>
> >> > > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> >> > > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> >> > > > > >>> to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a
> >> > > > at
> >> > > > > >>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
> >> > > > > >>> copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
> >> > > > > >>>
> >> > > > > >>> ..
> >> > > > > >>> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request]
> >> > > (secstorage-
> >> > > > > >>> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId:
> >> > > > 268749071320359,
> >> > > > > >>> via: 12,
> >> > > > > >>> Ver: v1, Flags: 100111,
> >> > > > > >>> [{"storage.*PrimaryStorageDownloadCommand*
> >> > > > > >>> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
> >> > > > > >>> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
> >> > > > > >>>
> >> > > > >
> >> > >
> >>74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8
> >> > > ae-
> >> > > > > >>> 32bb-94e1-
> >> > > > > >>>
> >> > > > > >>
> >> > > > >
> >> > > >
> >> > >
> >>74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2
> >> > > 049,
> >> > > > > >>> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> >> > > > > >>> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> >> > > > > >>> 10.10.171.155/export/primary","url":"nfs://
> >> > > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/
> >> > > > > ","format":"VHD","acco
> >> > > > > >>> untId":1,"name":"routing-1","wait":10800}}]
> >> > > > > >>> }
> >> > > > > >>>
> >> > > > > >>> ..
> >> > > > > >>> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
> >> > > > > >>> (DirectAgent-244:null) Seq 12-749863191: Processing:  {
> >>Ans: ,
> >> > > > MgmtId:
> >> > > > > >>> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> >> > > > > >>>
> >> > > > > >>
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details"
> >> > :"
> >> > > > > >>> Catch
> >> > > > > >>> Exception com.cloud.utils.exception.CloudRuntimeException on
> >> > > > > >>> host:21318624-cfd9-412d-aeb4-b1418424f287 for template:
> >>nfs://
> >> > > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> >> > > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> >> > > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> >> > > > > >>> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
> >> > > > > >>> b1e639b9b05a","wait":0}}] }
> >> > > > > >>>
> >> > > > > >>> Regards,
> >> > > > > >>> Amit
> >> > > > > >>> *CloudByte Inc.* <http://www.cloudbyte.com/>
> >> > > > > >>
> >> > > > >
> >> > > > >
> >> > > >
> >> > >
> >>
>
>

Re: System VMs not running

Posted by Nitin Mehta <Ni...@citrix.com>.
Donal - nice blog. 
One more thing you might want to add is that for these shell scripts you
can uncomment the set -x option in the scripts and run them yourself.
SmLog sometimes might not narrow down the issue but has the info about the
script path and the arguments. Once you uncomment the set -x and run it
yourself you can see the verbose output of the run.
Or better just uncomment the set -x option in the script and rerun the
entire operation. You should see a verbose output :)

Thanks,
-Nitin

On 23/08/13 2:56 PM, "Amit Das" <am...@cloudbyte.com> wrote:

>Thanks Donal for the site. It explains the issue pretty well.
>
>I had already gone through the SMLog by observing some already raised jira
>tickets. However, did not understand much then.
>
>Now i can see some *difference *between the logs on your blog vs. the ones
>in my XenServer.
>
>[28437] 2013-08-23 07:37:28.703267      #### VMOPS enter
> copy_vhd_from_secondarystorage ####
>[28437] 2013-08-23 07:37:28.703390      ['bash', '/opt/xensource/bin/*
>copy_vhd_from_secondarystorage.sh*', '10.10.171.155:*
>/export/secondary/template/tmpl/1/1/*',
>'b45c8c85-4e55-983c-cb16-4c2f2356951c',
>'cloud-ebed83d7-afde-4470-b867-312bad7c21c7']
>[28437] 2013-08-23 07:37:28.826465      SUCCESS
>[28437] 2013-08-23 07:37:28.826691      #### VMOPS exit
> copy_vhd_from_secondarystorage ####
>[28463] 2013-08-23 07:37:29.787555      #### VMOPS enter
>kill_copy_process
>####
>[28463] 2013-08-23 07:37:29.787680      ['bash',
>'/opt/xensource/bin/kill_copy_process.sh', '']
>[28463] 2013-08-23 07:37:29.800439      SUCCESS
>[28463] 2013-08-23 07:37:29.800565      #### VMOPS exit  kill_copy_process
>####
>
>The difference that I find here is the .vhd template is never mentioned in
>the copy_vhd_from_secondarystorage.sh
>Not sure if logic has changed.
>
>
>Regards,
>Amit
>*CloudByte Inc.* <http://www.cloudbyte.com/>
>
>
>On Fri, Aug 23, 2013 at 1:59 PM, Donal Lafferty
><do...@citrix.com>wrote:
>
>> HI Amit,
>>
>> Still having problems?
>>
>> Probably time to have a look at the logs on XenServer.  There's a guide
>> 
>>http://dlafferty.blogspot.co.uk/2013/08/using-cloudstacks-log-files-xense
>>rver.html
>>
>> DL
>>
>> > -----Original Message-----
>> > From: Amit Das [mailto:amit.das@cloudbyte.com]
>> > Sent: 23 August 2013 05:52
>> > To: dev@cloudstack.apache.org; aemneina@gmail.com
>> > Subject: Re: System VMs not running
>> >
>> > Yes. The step was missed.
>> >
>> > However, i tried out the steps on 'vhd_util' later & restarted nfs,
>> rpcbind &
>> > management services.
>> >
>> > Do i need to reset the DB as well ?
>> >
>> > Is there any work around for this ?
>> >
>> > Regards,
>> > Amit
>> > *CloudByte Inc.* <http://www.cloudbyte.com/>
>> >
>> >
>> > On Fri, Aug 23, 2013 at 9:56 AM, Ahmad Emneina <ae...@gmail.com>
>> > wrote:
>> >
>> > > this usually indicates that you missed the step where you prep
>> > > vhd-util on the hypervisor.
>> > >
>> > >
>> > > On Thu, Aug 22, 2013 at 9:18 PM, Amit Das <am...@cloudbyte.com>
>> > wrote:
>> > >
>> > > > The step worked fine after seeding system VM into secondary
>>storage
>> > > > location.
>> > > >
>> > > > However, i see the next error:
>> > > >
>> > > > WARN  [xen.resource.CitrixResourceBase] (DirectAgent-446:) Catch
>> > > Exception
>> > > > com.cloud.utils.exception.CloudRuntimeException on
>> > > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
>> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
>> > > > com.cloud.utils.exception.CloudRuntimeException: *can not create
>>vdi
>> > > > in
>> > > sr
>> > > > *
>> > > > b45c8c85-4e55-983c-cb16-4c2f2356951c
>> > > > com.cloud.utils.exception.CloudRuntimeException: can not create
>>vdi
>> > > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c
>> > > >         at
>> > > >
>> > > >
>> > >
>> > com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_sec
>> > > ondarystorage(CitrixResourceBase.java:2707)
>> > > >
>> > > > ...
>> > > >
>> > > > 2013-08-23 09:46:12,815 DEBUG [agent.transport.Request]
>> > > (secstorage-1:null)
>> > > > Seq 12-90517578: Sending  { Cmd , MgmtId: 268749071320359, via:
>>12,
>> Ver:
>> > > > v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
>> > > >
>> > > >
>> > > 
>>":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolUuid":
>> > > 
>>"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolId":211,"primaryPool":{"id
>> > > 
>>":211,"uuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","host":"10.10.171.
>> > > 
>>155","path":"/export/primary","port":2049,"type":"NetworkFilesystem"},
>> > > "secondaryStorageUrl":"nfs://
>> > > > 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
>> > > > 10.10.171.155/export/primary","url":"nfs://
>> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/
>> > > > ","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
>> > > > }
>> > > >
>> > > > ...
>> > > >
>> > > > 2013-08-23 09:46:15,077 DEBUG [agent.transport.Request]
>> > > > (DirectAgent-72:null) Seq 12-90517578: Processing:  { Ans: ,
>>MgmtId:
>> > > > 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
>> > > >
>> > > >
>> > > 
>>PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"detai
>> > > ls":"Catch
>> > > > Exception com.cloud.utils.exception.CloudRuntimeException on
>> > > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
>> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
>> > > > com.cloud.utils.exception.CloudRuntimeException: can not create
>>vdi
>> > > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c","wait":0}}] }
>> > > >
>> > > > Have i missed any other step for configuring primary & secondary
>> > storage.
>> > > >
>> > > > Regards,
>> > > > Amit
>> > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
>> > > >
>> > > >
>> > > > On Thu, Aug 22, 2013 at 5:24 PM, Harikrishna Patnala <
>> > > > harikrishna.patnala@citrix.com> wrote:
>> > > >
>> > > > > Please follow the link to seed the system template
>> > > > >
>> > > >
>> > > http://cloudstack.apache.org/docs/en-
>> > US/Apache_CloudStack/4.1.1/html/I
>> > > 
>>nstallation_Guide/management-server-install-flow.html#prepare-system-
>> > v
>> > > m-template
>> > > > >
>> > > > > -Harikrishna
>> > > > > On 22-Aug-2013, at 5:08 PM, Amit Das <am...@cloudbyte.com>
>> > > > >  wrote:
>> > > > >
>> > > > > > Hi,
>> > > > > >
>> > > > > > I have not seeded the secondary storage with system vm
>>template.
>> > > > > >
>> > > > > > The directory ../template/tmpl/1/1 is not present.
>> > > > > >
>> > > > > >
>> > > > > > Regards,
>> > > > > > Amit
>> > > > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
>> > > > > >
>> > > > > >
>> > > > > > On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <
>> > > > devdeep.singh@citrix.com
>> > > > > >wrote:
>> > > > > >
>> > > > > >> Did you seed the secondary storage with the systemvm template
>> > > > > >> before starting the setup? If not, can you check if under
>>your
>> > > > > >> secondary
>> > > > > storage
>> > > > > >> the ../template/tmpl/1/1 directory is present?
>> > > > > >>
>> > > > > >> Regards,
>> > > > > >> Devdeep
>> > > > > >>
>> > > > > >>> -----Original Message-----
>> > > > > >>> From: Amit Das [mailto:amit.das@cloudbyte.com]
>> > > > > >>> Sent: Thursday, August 22, 2013 4:50 PM
>> > > > > >>> To: dev@cloudstack.apache.org
>> > > > > >>> Subject: System VMs not running
>> > > > > >>>
>> > > > > >>> Hi folks,
>> > > > > >>>
>> > > > > >>> I am running CloudStack 4.1.1. & running the NFS share on
>>the
>> > > > > >>> same
>> > > > box
>> > > > > as
>> > > > > >>> CloudStack management server (CentOS 6). The hypervisor is a
>> > > separate
>> > > > > Xen
>> > > > > >>> server.
>> > > > > >>>
>> > > > > >>> I am not able to get the system vms in a running state.
>> > > > > >>> We had not downloaded the vhd-util initially but it has been
>> > > > downloaded
>> > > > > >> now.
>> > > > > >>> The management server has been restarted & appropriate
>> > > > > >>> rpcbind, nfs services started. The configuration was redone
>> from
>> > scratch.
>> > > However,
>> > > > > we
>> > > > > >> are
>> > > > > >>> stuck with below error always.
>> > > > > >>>
>> > > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
>> > > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
>> > > > > >>> to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a
>> > > > at
>> > > > > >>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
>> > > > > >>> copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
>> > > > > >>>
>> > > > > >>> ..
>> > > > > >>> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request]
>> > > (secstorage-
>> > > > > >>> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId:
>> > > > 268749071320359,
>> > > > > >>> via: 12,
>> > > > > >>> Ver: v1, Flags: 100111,
>> > > > > >>> [{"storage.*PrimaryStorageDownloadCommand*
>> > > > > >>> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
>> > > > > >>> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
>> > > > > >>>
>> > > > >
>> > > 
>>74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8
>> > > ae-
>> > > > > >>> 32bb-94e1-
>> > > > > >>>
>> > > > > >>
>> > > > >
>> > > >
>> > > 
>>74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2
>> > > 049,
>> > > > > >>> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
>> > > > > >>> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
>> > > > > >>> 10.10.171.155/export/primary","url":"nfs://
>> > > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/
>> > > > > ","format":"VHD","acco
>> > > > > >>> untId":1,"name":"routing-1","wait":10800}}]
>> > > > > >>> }
>> > > > > >>>
>> > > > > >>> ..
>> > > > > >>> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
>> > > > > >>> (DirectAgent-244:null) Seq 12-749863191: Processing:  {
>>Ans: ,
>> > > > MgmtId:
>> > > > > >>> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
>> > > > > >>>
>> > > > > >>
>> > > > >
>> > > >
>> > >
>> > 
>>PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details"
>> > :"
>> > > > > >>> Catch
>> > > > > >>> Exception com.cloud.utils.exception.CloudRuntimeException on
>> > > > > >>> host:21318624-cfd9-412d-aeb4-b1418424f287 for template:
>>nfs://
>> > > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
>> > > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
>> > > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
>> > > > > >>> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
>> > > > > >>> b1e639b9b05a","wait":0}}] }
>> > > > > >>>
>> > > > > >>> Regards,
>> > > > > >>> Amit
>> > > > > >>> *CloudByte Inc.* <http://www.cloudbyte.com/>
>> > > > > >>
>> > > > >
>> > > > >
>> > > >
>> > >
>>


Re: System VMs not running

Posted by Amit Das <am...@cloudbyte.com>.
Thanks Donal for the site. It explains the issue pretty well.

I had already gone through the SMLog by observing some already raised jira
tickets. However, did not understand much then.

Now i can see some *difference *between the logs on your blog vs. the ones
in my XenServer.

[28437] 2013-08-23 07:37:28.703267      #### VMOPS enter
 copy_vhd_from_secondarystorage ####
[28437] 2013-08-23 07:37:28.703390      ['bash', '/opt/xensource/bin/*
copy_vhd_from_secondarystorage.sh*', '10.10.171.155:*
/export/secondary/template/tmpl/1/1/*',
'b45c8c85-4e55-983c-cb16-4c2f2356951c',
'cloud-ebed83d7-afde-4470-b867-312bad7c21c7']
[28437] 2013-08-23 07:37:28.826465      SUCCESS
[28437] 2013-08-23 07:37:28.826691      #### VMOPS exit
 copy_vhd_from_secondarystorage ####
[28463] 2013-08-23 07:37:29.787555      #### VMOPS enter  kill_copy_process
####
[28463] 2013-08-23 07:37:29.787680      ['bash',
'/opt/xensource/bin/kill_copy_process.sh', '']
[28463] 2013-08-23 07:37:29.800439      SUCCESS
[28463] 2013-08-23 07:37:29.800565      #### VMOPS exit  kill_copy_process
####

The difference that I find here is the .vhd template is never mentioned in
the copy_vhd_from_secondarystorage.sh
Not sure if logic has changed.


Regards,
Amit
*CloudByte Inc.* <http://www.cloudbyte.com/>


On Fri, Aug 23, 2013 at 1:59 PM, Donal Lafferty
<do...@citrix.com>wrote:

> HI Amit,
>
> Still having problems?
>
> Probably time to have a look at the logs on XenServer.  There's a guide
> http://dlafferty.blogspot.co.uk/2013/08/using-cloudstacks-log-files-xenserver.html
>
> DL
>
> > -----Original Message-----
> > From: Amit Das [mailto:amit.das@cloudbyte.com]
> > Sent: 23 August 2013 05:52
> > To: dev@cloudstack.apache.org; aemneina@gmail.com
> > Subject: Re: System VMs not running
> >
> > Yes. The step was missed.
> >
> > However, i tried out the steps on 'vhd_util' later & restarted nfs,
> rpcbind &
> > management services.
> >
> > Do i need to reset the DB as well ?
> >
> > Is there any work around for this ?
> >
> > Regards,
> > Amit
> > *CloudByte Inc.* <http://www.cloudbyte.com/>
> >
> >
> > On Fri, Aug 23, 2013 at 9:56 AM, Ahmad Emneina <ae...@gmail.com>
> > wrote:
> >
> > > this usually indicates that you missed the step where you prep
> > > vhd-util on the hypervisor.
> > >
> > >
> > > On Thu, Aug 22, 2013 at 9:18 PM, Amit Das <am...@cloudbyte.com>
> > wrote:
> > >
> > > > The step worked fine after seeding system VM into secondary storage
> > > > location.
> > > >
> > > > However, i see the next error:
> > > >
> > > > WARN  [xen.resource.CitrixResourceBase] (DirectAgent-446:) Catch
> > > Exception
> > > > com.cloud.utils.exception.CloudRuntimeException on
> > > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > > > com.cloud.utils.exception.CloudRuntimeException: *can not create vdi
> > > > in
> > > sr
> > > > *
> > > > b45c8c85-4e55-983c-cb16-4c2f2356951c
> > > > com.cloud.utils.exception.CloudRuntimeException: can not create vdi
> > > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c
> > > >         at
> > > >
> > > >
> > >
> > com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_sec
> > > ondarystorage(CitrixResourceBase.java:2707)
> > > >
> > > > ...
> > > >
> > > > 2013-08-23 09:46:12,815 DEBUG [agent.transport.Request]
> > > (secstorage-1:null)
> > > > Seq 12-90517578: Sending  { Cmd , MgmtId: 268749071320359, via: 12,
> Ver:
> > > > v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
> > > >
> > > >
> > > ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolUuid":
> > > "15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolId":211,"primaryPool":{"id
> > > ":211,"uuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","host":"10.10.171.
> > > 155","path":"/export/primary","port":2049,"type":"NetworkFilesystem"},
> > > "secondaryStorageUrl":"nfs://
> > > > 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> > > > 10.10.171.155/export/primary","url":"nfs://
> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/
> > > > ","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
> > > > }
> > > >
> > > > ...
> > > >
> > > > 2013-08-23 09:46:15,077 DEBUG [agent.transport.Request]
> > > > (DirectAgent-72:null) Seq 12-90517578: Processing:  { Ans: , MgmtId:
> > > > 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> > > >
> > > >
> > > PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"detai
> > > ls":"Catch
> > > > Exception com.cloud.utils.exception.CloudRuntimeException on
> > > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > > > com.cloud.utils.exception.CloudRuntimeException: can not create vdi
> > > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c","wait":0}}] }
> > > >
> > > > Have i missed any other step for configuring primary & secondary
> > storage.
> > > >
> > > > Regards,
> > > > Amit
> > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
> > > >
> > > >
> > > > On Thu, Aug 22, 2013 at 5:24 PM, Harikrishna Patnala <
> > > > harikrishna.patnala@citrix.com> wrote:
> > > >
> > > > > Please follow the link to seed the system template
> > > > >
> > > >
> > > http://cloudstack.apache.org/docs/en-
> > US/Apache_CloudStack/4.1.1/html/I
> > > nstallation_Guide/management-server-install-flow.html#prepare-system-
> > v
> > > m-template
> > > > >
> > > > > -Harikrishna
> > > > > On 22-Aug-2013, at 5:08 PM, Amit Das <am...@cloudbyte.com>
> > > > >  wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I have not seeded the secondary storage with system vm template.
> > > > > >
> > > > > > The directory ../template/tmpl/1/1 is not present.
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Amit
> > > > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
> > > > > >
> > > > > >
> > > > > > On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <
> > > > devdeep.singh@citrix.com
> > > > > >wrote:
> > > > > >
> > > > > >> Did you seed the secondary storage with the systemvm template
> > > > > >> before starting the setup? If not, can you check if under your
> > > > > >> secondary
> > > > > storage
> > > > > >> the ../template/tmpl/1/1 directory is present?
> > > > > >>
> > > > > >> Regards,
> > > > > >> Devdeep
> > > > > >>
> > > > > >>> -----Original Message-----
> > > > > >>> From: Amit Das [mailto:amit.das@cloudbyte.com]
> > > > > >>> Sent: Thursday, August 22, 2013 4:50 PM
> > > > > >>> To: dev@cloudstack.apache.org
> > > > > >>> Subject: System VMs not running
> > > > > >>>
> > > > > >>> Hi folks,
> > > > > >>>
> > > > > >>> I am running CloudStack 4.1.1. & running the NFS share on the
> > > > > >>> same
> > > > box
> > > > > as
> > > > > >>> CloudStack management server (CentOS 6). The hypervisor is a
> > > separate
> > > > > Xen
> > > > > >>> server.
> > > > > >>>
> > > > > >>> I am not able to get the system vms in a running state.
> > > > > >>> We had not downloaded the vhd-util initially but it has been
> > > > downloaded
> > > > > >> now.
> > > > > >>> The management server has been restarted & appropriate
> > > > > >>> rpcbind, nfs services started. The configuration was redone
> from
> > scratch.
> > > However,
> > > > > we
> > > > > >> are
> > > > > >>> stuck with below error always.
> > > > > >>>
> > > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> > > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> > > > > >>> to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a
> > > > at
> > > > > >>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
> > > > > >>> copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
> > > > > >>>
> > > > > >>> ..
> > > > > >>> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request]
> > > (secstorage-
> > > > > >>> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId:
> > > > 268749071320359,
> > > > > >>> via: 12,
> > > > > >>> Ver: v1, Flags: 100111,
> > > > > >>> [{"storage.*PrimaryStorageDownloadCommand*
> > > > > >>> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
> > > > > >>> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
> > > > > >>>
> > > > >
> > > 74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8
> > > ae-
> > > > > >>> 32bb-94e1-
> > > > > >>>
> > > > > >>
> > > > >
> > > >
> > > 74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2
> > > 049,
> > > > > >>> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> > > > > >>> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> > > > > >>> 10.10.171.155/export/primary","url":"nfs://
> > > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/
> > > > > ","format":"VHD","acco
> > > > > >>> untId":1,"name":"routing-1","wait":10800}}]
> > > > > >>> }
> > > > > >>>
> > > > > >>> ..
> > > > > >>> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
> > > > > >>> (DirectAgent-244:null) Seq 12-749863191: Processing:  { Ans: ,
> > > > MgmtId:
> > > > > >>> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> > > > > >>>
> > > > > >>
> > > > >
> > > >
> > >
> > PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details"
> > :"
> > > > > >>> Catch
> > > > > >>> Exception com.cloud.utils.exception.CloudRuntimeException on
> > > > > >>> host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> > > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> > > > > >>> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
> > > > > >>> b1e639b9b05a","wait":0}}] }
> > > > > >>>
> > > > > >>> Regards,
> > > > > >>> Amit
> > > > > >>> *CloudByte Inc.* <http://www.cloudbyte.com/>
> > > > > >>
> > > > >
> > > > >
> > > >
> > >
>

RE: System VMs not running

Posted by Donal Lafferty <do...@citrix.com>.
HI Amit,

Still having problems?  

Probably time to have a look at the logs on XenServer.  There's a guide http://dlafferty.blogspot.co.uk/2013/08/using-cloudstacks-log-files-xenserver.html

DL

> -----Original Message-----
> From: Amit Das [mailto:amit.das@cloudbyte.com]
> Sent: 23 August 2013 05:52
> To: dev@cloudstack.apache.org; aemneina@gmail.com
> Subject: Re: System VMs not running
> 
> Yes. The step was missed.
> 
> However, i tried out the steps on 'vhd_util' later & restarted nfs, rpcbind &
> management services.
> 
> Do i need to reset the DB as well ?
> 
> Is there any work around for this ?
> 
> Regards,
> Amit
> *CloudByte Inc.* <http://www.cloudbyte.com/>
> 
> 
> On Fri, Aug 23, 2013 at 9:56 AM, Ahmad Emneina <ae...@gmail.com>
> wrote:
> 
> > this usually indicates that you missed the step where you prep
> > vhd-util on the hypervisor.
> >
> >
> > On Thu, Aug 22, 2013 at 9:18 PM, Amit Das <am...@cloudbyte.com>
> wrote:
> >
> > > The step worked fine after seeding system VM into secondary storage
> > > location.
> > >
> > > However, i see the next error:
> > >
> > > WARN  [xen.resource.CitrixResourceBase] (DirectAgent-446:) Catch
> > Exception
> > > com.cloud.utils.exception.CloudRuntimeException on
> > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > > com.cloud.utils.exception.CloudRuntimeException: *can not create vdi
> > > in
> > sr
> > > *
> > > b45c8c85-4e55-983c-cb16-4c2f2356951c
> > > com.cloud.utils.exception.CloudRuntimeException: can not create vdi
> > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c
> > >         at
> > >
> > >
> >
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_sec
> > ondarystorage(CitrixResourceBase.java:2707)
> > >
> > > ...
> > >
> > > 2013-08-23 09:46:12,815 DEBUG [agent.transport.Request]
> > (secstorage-1:null)
> > > Seq 12-90517578: Sending  { Cmd , MgmtId: 268749071320359, via: 12, Ver:
> > > v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
> > >
> > >
> > ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolUuid":
> > "15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolId":211,"primaryPool":{"id
> > ":211,"uuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","host":"10.10.171.
> > 155","path":"/export/primary","port":2049,"type":"NetworkFilesystem"},
> > "secondaryStorageUrl":"nfs://
> > > 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> > > 10.10.171.155/export/primary","url":"nfs://
> > > 10.10.171.155/export/secondary/template/tmpl/1/1/
> > > ","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
> > > }
> > >
> > > ...
> > >
> > > 2013-08-23 09:46:15,077 DEBUG [agent.transport.Request]
> > > (DirectAgent-72:null) Seq 12-90517578: Processing:  { Ans: , MgmtId:
> > > 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> > >
> > >
> > PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"detai
> > ls":"Catch
> > > Exception com.cloud.utils.exception.CloudRuntimeException on
> > > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > > com.cloud.utils.exception.CloudRuntimeException: can not create vdi
> > > in sr b45c8c85-4e55-983c-cb16-4c2f2356951c","wait":0}}] }
> > >
> > > Have i missed any other step for configuring primary & secondary
> storage.
> > >
> > > Regards,
> > > Amit
> > > *CloudByte Inc.* <http://www.cloudbyte.com/>
> > >
> > >
> > > On Thu, Aug 22, 2013 at 5:24 PM, Harikrishna Patnala <
> > > harikrishna.patnala@citrix.com> wrote:
> > >
> > > > Please follow the link to seed the system template
> > > >
> > >
> > http://cloudstack.apache.org/docs/en-
> US/Apache_CloudStack/4.1.1/html/I
> > nstallation_Guide/management-server-install-flow.html#prepare-system-
> v
> > m-template
> > > >
> > > > -Harikrishna
> > > > On 22-Aug-2013, at 5:08 PM, Amit Das <am...@cloudbyte.com>
> > > >  wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I have not seeded the secondary storage with system vm template.
> > > > >
> > > > > The directory ../template/tmpl/1/1 is not present.
> > > > >
> > > > >
> > > > > Regards,
> > > > > Amit
> > > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
> > > > >
> > > > >
> > > > > On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <
> > > devdeep.singh@citrix.com
> > > > >wrote:
> > > > >
> > > > >> Did you seed the secondary storage with the systemvm template
> > > > >> before starting the setup? If not, can you check if under your
> > > > >> secondary
> > > > storage
> > > > >> the ../template/tmpl/1/1 directory is present?
> > > > >>
> > > > >> Regards,
> > > > >> Devdeep
> > > > >>
> > > > >>> -----Original Message-----
> > > > >>> From: Amit Das [mailto:amit.das@cloudbyte.com]
> > > > >>> Sent: Thursday, August 22, 2013 4:50 PM
> > > > >>> To: dev@cloudstack.apache.org
> > > > >>> Subject: System VMs not running
> > > > >>>
> > > > >>> Hi folks,
> > > > >>>
> > > > >>> I am running CloudStack 4.1.1. & running the NFS share on the
> > > > >>> same
> > > box
> > > > as
> > > > >>> CloudStack management server (CentOS 6). The hypervisor is a
> > separate
> > > > Xen
> > > > >>> server.
> > > > >>>
> > > > >>> I am not able to get the system vms in a running state.
> > > > >>> We had not downloaded the vhd-util initially but it has been
> > > downloaded
> > > > >> now.
> > > > >>> The management server has been restarted & appropriate
> > > > >>> rpcbind, nfs services started. The configuration was redone from
> scratch.
> > However,
> > > > we
> > > > >> are
> > > > >>> stuck with below error always.
> > > > >>>
> > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> > > > >>> to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a
> > > at
> > > > >>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
> > > > >>> copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
> > > > >>>
> > > > >>> ..
> > > > >>> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request]
> > (secstorage-
> > > > >>> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId:
> > > 268749071320359,
> > > > >>> via: 12,
> > > > >>> Ver: v1, Flags: 100111,
> > > > >>> [{"storage.*PrimaryStorageDownloadCommand*
> > > > >>> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
> > > > >>> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
> > > > >>>
> > > >
> > 74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8
> > ae-
> > > > >>> 32bb-94e1-
> > > > >>>
> > > > >>
> > > >
> > >
> > 74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2
> > 049,
> > > > >>> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> > > > >>> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> > > > >>> 10.10.171.155/export/primary","url":"nfs://
> > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/
> > > > ","format":"VHD","acco
> > > > >>> untId":1,"name":"routing-1","wait":10800}}]
> > > > >>> }
> > > > >>>
> > > > >>> ..
> > > > >>> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
> > > > >>> (DirectAgent-244:null) Seq 12-749863191: Processing:  { Ans: ,
> > > MgmtId:
> > > > >>> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> > > > >>>
> > > > >>
> > > >
> > >
> >
> PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details"
> :"
> > > > >>> Catch
> > > > >>> Exception com.cloud.utils.exception.CloudRuntimeException on
> > > > >>> host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> > > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> > > > >>> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
> > > > >>> b1e639b9b05a","wait":0}}] }
> > > > >>>
> > > > >>> Regards,
> > > > >>> Amit
> > > > >>> *CloudByte Inc.* <http://www.cloudbyte.com/>
> > > > >>
> > > >
> > > >
> > >
> >

Re: System VMs not running

Posted by Amit Das <am...@cloudbyte.com>.
Yes. The step was missed.

However, i tried out the steps on 'vhd_util' later & restarted nfs, rpcbind
& management services.

Do i need to reset the DB as well ?

Is there any work around for this ?

Regards,
Amit
*CloudByte Inc.* <http://www.cloudbyte.com/>


On Fri, Aug 23, 2013 at 9:56 AM, Ahmad Emneina <ae...@gmail.com> wrote:

> this usually indicates that you missed the step where you prep vhd-util on
> the hypervisor.
>
>
> On Thu, Aug 22, 2013 at 9:18 PM, Amit Das <am...@cloudbyte.com> wrote:
>
> > The step worked fine after seeding system VM into secondary storage
> > location.
> >
> > However, i see the next error:
> >
> > WARN  [xen.resource.CitrixResourceBase] (DirectAgent-446:) Catch
> Exception
> > com.cloud.utils.exception.CloudRuntimeException on
> > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > com.cloud.utils.exception.CloudRuntimeException: *can not create vdi in
> sr
> > *
> > b45c8c85-4e55-983c-cb16-4c2f2356951c
> > com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
> > b45c8c85-4e55-983c-cb16-4c2f2356951c
> >         at
> >
> >
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
> >
> > ...
> >
> > 2013-08-23 09:46:12,815 DEBUG [agent.transport.Request]
> (secstorage-1:null)
> > Seq 12-90517578: Sending  { Cmd , MgmtId: 268749071320359, via: 12, Ver:
> > v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
> >
> >
> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,"type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> > 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> > 10.10.171.155/export/primary","url":"nfs://
> > 10.10.171.155/export/secondary/template/tmpl/1/1/
> > ","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
> > }
> >
> > ...
> >
> > 2013-08-23 09:46:15,077 DEBUG [agent.transport.Request]
> > (DirectAgent-72:null) Seq 12-90517578: Processing:  { Ans: , MgmtId:
> > 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> >
> >
> PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"Catch
> > Exception com.cloud.utils.exception.CloudRuntimeException on
> > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
> > b45c8c85-4e55-983c-cb16-4c2f2356951c","wait":0}}] }
> >
> > Have i missed any other step for configuring primary & secondary storage.
> >
> > Regards,
> > Amit
> > *CloudByte Inc.* <http://www.cloudbyte.com/>
> >
> >
> > On Thu, Aug 22, 2013 at 5:24 PM, Harikrishna Patnala <
> > harikrishna.patnala@citrix.com> wrote:
> >
> > > Please follow the link to seed the system template
> > >
> >
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Installation_Guide/management-server-install-flow.html#prepare-system-vm-template
> > >
> > > -Harikrishna
> > > On 22-Aug-2013, at 5:08 PM, Amit Das <am...@cloudbyte.com>
> > >  wrote:
> > >
> > > > Hi,
> > > >
> > > > I have not seeded the secondary storage with system vm template.
> > > >
> > > > The directory ../template/tmpl/1/1 is not present.
> > > >
> > > >
> > > > Regards,
> > > > Amit
> > > > *CloudByte Inc.* <http://www.cloudbyte.com/>
> > > >
> > > >
> > > > On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <
> > devdeep.singh@citrix.com
> > > >wrote:
> > > >
> > > >> Did you seed the secondary storage with the systemvm template before
> > > >> starting the setup? If not, can you check if under your secondary
> > > storage
> > > >> the ../template/tmpl/1/1 directory is present?
> > > >>
> > > >> Regards,
> > > >> Devdeep
> > > >>
> > > >>> -----Original Message-----
> > > >>> From: Amit Das [mailto:amit.das@cloudbyte.com]
> > > >>> Sent: Thursday, August 22, 2013 4:50 PM
> > > >>> To: dev@cloudstack.apache.org
> > > >>> Subject: System VMs not running
> > > >>>
> > > >>> Hi folks,
> > > >>>
> > > >>> I am running CloudStack 4.1.1. & running the NFS share on the same
> > box
> > > as
> > > >>> CloudStack management server (CentOS 6). The hypervisor is a
> separate
> > > Xen
> > > >>> server.
> > > >>>
> > > >>> I am not able to get the system vms in a running state.
> > > >>> We had not downloaded the vhd-util initially but it has been
> > downloaded
> > > >> now.
> > > >>> The management server has been restarted & appropriate rpcbind, nfs
> > > >>> services started. The configuration was redone from scratch.
> However,
> > > we
> > > >> are
> > > >>> stuck with below error always.
> > > >>>
> > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> > > >>> to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a
> > at
> > > >>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
> > > >>> copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
> > > >>>
> > > >>> ..
> > > >>> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request]
> (secstorage-
> > > >>> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId:
> > 268749071320359,
> > > >>> via: 12,
> > > >>> Ver: v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
> > > >>> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
> > > >>> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
> > > >>>
> > >
> 74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-
> > > >>> 32bb-94e1-
> > > >>>
> > > >>
> > >
> >
> 74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,
> > > >>> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> > > >>> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> > > >>> 10.10.171.155/export/primary","url":"nfs://
> > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/
> > > ","format":"VHD","acco
> > > >>> untId":1,"name":"routing-1","wait":10800}}]
> > > >>> }
> > > >>>
> > > >>> ..
> > > >>> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
> > > >>> (DirectAgent-244:null) Seq 12-749863191: Processing:  { Ans: ,
> > MgmtId:
> > > >>> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> > > >>>
> > > >>
> > >
> >
> PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"
> > > >>> Catch
> > > >>> Exception com.cloud.utils.exception.CloudRuntimeException on
> > > >>> host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> > > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> > > >>> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
> > > >>> b1e639b9b05a","wait":0}}] }
> > > >>>
> > > >>> Regards,
> > > >>> Amit
> > > >>> *CloudByte Inc.* <http://www.cloudbyte.com/>
> > > >>
> > >
> > >
> >
>

Re: System VMs not running

Posted by Ahmad Emneina <ae...@gmail.com>.
this usually indicates that you missed the step where you prep vhd-util on
the hypervisor.


On Thu, Aug 22, 2013 at 9:18 PM, Amit Das <am...@cloudbyte.com> wrote:

> The step worked fine after seeding system VM into secondary storage
> location.
>
> However, i see the next error:
>
> WARN  [xen.resource.CitrixResourceBase] (DirectAgent-446:) Catch Exception
> com.cloud.utils.exception.CloudRuntimeException on
> host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> com.cloud.utils.exception.CloudRuntimeException: *can not create vdi in sr
> *
> b45c8c85-4e55-983c-cb16-4c2f2356951c
> com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
> b45c8c85-4e55-983c-cb16-4c2f2356951c
>         at
>
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
>
> ...
>
> 2013-08-23 09:46:12,815 DEBUG [agent.transport.Request] (secstorage-1:null)
> Seq 12-90517578: Sending  { Cmd , MgmtId: 268749071320359, via: 12, Ver:
> v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
>
> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,"type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> 10.10.171.155/export/primary","url":"nfs://
> 10.10.171.155/export/secondary/template/tmpl/1/1/
> ","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
> }
>
> ...
>
> 2013-08-23 09:46:15,077 DEBUG [agent.transport.Request]
> (DirectAgent-72:null) Seq 12-90517578: Processing:  { Ans: , MgmtId:
> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
>
> PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"Catch
> Exception com.cloud.utils.exception.CloudRuntimeException on
> host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
> b45c8c85-4e55-983c-cb16-4c2f2356951c","wait":0}}] }
>
> Have i missed any other step for configuring primary & secondary storage.
>
> Regards,
> Amit
> *CloudByte Inc.* <http://www.cloudbyte.com/>
>
>
> On Thu, Aug 22, 2013 at 5:24 PM, Harikrishna Patnala <
> harikrishna.patnala@citrix.com> wrote:
>
> > Please follow the link to seed the system template
> >
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Installation_Guide/management-server-install-flow.html#prepare-system-vm-template
> >
> > -Harikrishna
> > On 22-Aug-2013, at 5:08 PM, Amit Das <am...@cloudbyte.com>
> >  wrote:
> >
> > > Hi,
> > >
> > > I have not seeded the secondary storage with system vm template.
> > >
> > > The directory ../template/tmpl/1/1 is not present.
> > >
> > >
> > > Regards,
> > > Amit
> > > *CloudByte Inc.* <http://www.cloudbyte.com/>
> > >
> > >
> > > On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <
> devdeep.singh@citrix.com
> > >wrote:
> > >
> > >> Did you seed the secondary storage with the systemvm template before
> > >> starting the setup? If not, can you check if under your secondary
> > storage
> > >> the ../template/tmpl/1/1 directory is present?
> > >>
> > >> Regards,
> > >> Devdeep
> > >>
> > >>> -----Original Message-----
> > >>> From: Amit Das [mailto:amit.das@cloudbyte.com]
> > >>> Sent: Thursday, August 22, 2013 4:50 PM
> > >>> To: dev@cloudstack.apache.org
> > >>> Subject: System VMs not running
> > >>>
> > >>> Hi folks,
> > >>>
> > >>> I am running CloudStack 4.1.1. & running the NFS share on the same
> box
> > as
> > >>> CloudStack management server (CentOS 6). The hypervisor is a separate
> > Xen
> > >>> server.
> > >>>
> > >>> I am not able to get the system vms in a running state.
> > >>> We had not downloaded the vhd-util initially but it has been
> downloaded
> > >> now.
> > >>> The management server has been restarted & appropriate rpcbind, nfs
> > >>> services started. The configuration was redone from scratch. However,
> > we
> > >> are
> > >>> stuck with below error always.
> > >>>
> > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> > >>> to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a
> at
> > >>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
> > >>> copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
> > >>>
> > >>> ..
> > >>> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request] (secstorage-
> > >>> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId:
> 268749071320359,
> > >>> via: 12,
> > >>> Ver: v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
> > >>> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
> > >>> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
> > >>>
> > 74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-
> > >>> 32bb-94e1-
> > >>>
> > >>
> >
> 74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,
> > >>> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> > >>> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> > >>> 10.10.171.155/export/primary","url":"nfs://
> > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/
> > ","format":"VHD","acco
> > >>> untId":1,"name":"routing-1","wait":10800}}]
> > >>> }
> > >>>
> > >>> ..
> > >>> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
> > >>> (DirectAgent-244:null) Seq 12-749863191: Processing:  { Ans: ,
> MgmtId:
> > >>> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> > >>>
> > >>
> >
> PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"
> > >>> Catch
> > >>> Exception com.cloud.utils.exception.CloudRuntimeException on
> > >>> host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > >>> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> > >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> > >>> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
> > >>> b1e639b9b05a","wait":0}}] }
> > >>>
> > >>> Regards,
> > >>> Amit
> > >>> *CloudByte Inc.* <http://www.cloudbyte.com/>
> > >>
> >
> >
>

Re: System VMs not running

Posted by Amit Das <am...@cloudbyte.com>.
The step worked fine after seeding system VM into secondary storage
location.

However, i see the next error:

WARN  [xen.resource.CitrixResourceBase] (DirectAgent-446:) Catch Exception
com.cloud.utils.exception.CloudRuntimeException on
host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
10.10.171.155/export/secondary/template/tmpl/1/1/ due to
com.cloud.utils.exception.CloudRuntimeException: *can not create vdi in sr *
b45c8c85-4e55-983c-cb16-4c2f2356951c
com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
b45c8c85-4e55-983c-cb16-4c2f2356951c
        at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)

...

2013-08-23 09:46:12,815 DEBUG [agent.transport.Request] (secstorage-1:null)
Seq 12-90517578: Sending  { Cmd , MgmtId: 268749071320359, via: 12, Ver:
v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-32bb-94e1-74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,"type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
10.10.171.155/export/primary","url":"nfs://
10.10.171.155/export/secondary/template/tmpl/1/1/","format":"VHD","accountId":1,"name":"routing-1","wait":10800}}]
}

...

2013-08-23 09:46:15,077 DEBUG [agent.transport.Request]
(DirectAgent-72:null) Seq 12-90517578: Processing:  { Ans: , MgmtId:
268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"Catch
Exception com.cloud.utils.exception.CloudRuntimeException on
host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
10.10.171.155/export/secondary/template/tmpl/1/1/ due to
com.cloud.utils.exception.CloudRuntimeException: can not create vdi in sr
b45c8c85-4e55-983c-cb16-4c2f2356951c","wait":0}}] }

Have i missed any other step for configuring primary & secondary storage.

Regards,
Amit
*CloudByte Inc.* <http://www.cloudbyte.com/>


On Thu, Aug 22, 2013 at 5:24 PM, Harikrishna Patnala <
harikrishna.patnala@citrix.com> wrote:

> Please follow the link to seed the system template
> http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Installation_Guide/management-server-install-flow.html#prepare-system-vm-template
>
> -Harikrishna
> On 22-Aug-2013, at 5:08 PM, Amit Das <am...@cloudbyte.com>
>  wrote:
>
> > Hi,
> >
> > I have not seeded the secondary storage with system vm template.
> >
> > The directory ../template/tmpl/1/1 is not present.
> >
> >
> > Regards,
> > Amit
> > *CloudByte Inc.* <http://www.cloudbyte.com/>
> >
> >
> > On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <devdeep.singh@citrix.com
> >wrote:
> >
> >> Did you seed the secondary storage with the systemvm template before
> >> starting the setup? If not, can you check if under your secondary
> storage
> >> the ../template/tmpl/1/1 directory is present?
> >>
> >> Regards,
> >> Devdeep
> >>
> >>> -----Original Message-----
> >>> From: Amit Das [mailto:amit.das@cloudbyte.com]
> >>> Sent: Thursday, August 22, 2013 4:50 PM
> >>> To: dev@cloudstack.apache.org
> >>> Subject: System VMs not running
> >>>
> >>> Hi folks,
> >>>
> >>> I am running CloudStack 4.1.1. & running the NFS share on the same box
> as
> >>> CloudStack management server (CentOS 6). The hypervisor is a separate
> Xen
> >>> server.
> >>>
> >>> I am not able to get the system vms in a running state.
> >>> We had not downloaded the vhd-util initially but it has been downloaded
> >> now.
> >>> The management server has been restarted & appropriate rpcbind, nfs
> >>> services started. The configuration was redone from scratch. However,
> we
> >> are
> >>> stuck with below error always.
> >>>
> >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> >>> to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a         at
> >>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
> >>> copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
> >>>
> >>> ..
> >>> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request] (secstorage-
> >>> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId: 268749071320359,
> >>> via: 12,
> >>> Ver: v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
> >>> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
> >>> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
> >>>
> 74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-
> >>> 32bb-94e1-
> >>>
> >>
> 74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,
> >>> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> >>> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> >>> 10.10.171.155/export/primary","url":"nfs://
> >>> 10.10.171.155/export/secondary/template/tmpl/1/1/
> ","format":"VHD","acco
> >>> untId":1,"name":"routing-1","wait":10800}}]
> >>> }
> >>>
> >>> ..
> >>> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
> >>> (DirectAgent-244:null) Seq 12-749863191: Processing:  { Ans: , MgmtId:
> >>> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> >>>
> >>
> PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"
> >>> Catch
> >>> Exception com.cloud.utils.exception.CloudRuntimeException on
> >>> host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> >>> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> >>> com.cloud.utils.exception.CloudRuntimeException: can't mount
> >>> 10.10.171.155:/export/secondary/template/tmpl/1/1
> >>> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
> >>> b1e639b9b05a","wait":0}}] }
> >>>
> >>> Regards,
> >>> Amit
> >>> *CloudByte Inc.* <http://www.cloudbyte.com/>
> >>
>
>

Re: System VMs not running

Posted by Harikrishna Patnala <ha...@citrix.com>.
Please follow the link to seed the system template http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.1.1/html/Installation_Guide/management-server-install-flow.html#prepare-system-vm-template

-Harikrishna
On 22-Aug-2013, at 5:08 PM, Amit Das <am...@cloudbyte.com>
 wrote:

> Hi,
> 
> I have not seeded the secondary storage with system vm template.
> 
> The directory ../template/tmpl/1/1 is not present.
> 
> 
> Regards,
> Amit
> *CloudByte Inc.* <http://www.cloudbyte.com/>
> 
> 
> On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <de...@citrix.com>wrote:
> 
>> Did you seed the secondary storage with the systemvm template before
>> starting the setup? If not, can you check if under your secondary storage
>> the ../template/tmpl/1/1 directory is present?
>> 
>> Regards,
>> Devdeep
>> 
>>> -----Original Message-----
>>> From: Amit Das [mailto:amit.das@cloudbyte.com]
>>> Sent: Thursday, August 22, 2013 4:50 PM
>>> To: dev@cloudstack.apache.org
>>> Subject: System VMs not running
>>> 
>>> Hi folks,
>>> 
>>> I am running CloudStack 4.1.1. & running the NFS share on the same box as
>>> CloudStack management server (CentOS 6). The hypervisor is a separate Xen
>>> server.
>>> 
>>> I am not able to get the system vms in a running state.
>>> We had not downloaded the vhd-util initially but it has been downloaded
>> now.
>>> The management server has been restarted & appropriate rpcbind, nfs
>>> services started. The configuration was redone from scratch. However, we
>> are
>>> stuck with below error always.
>>> 
>>> com.cloud.utils.exception.CloudRuntimeException: can't mount
>>> 10.10.171.155:/export/secondary/template/tmpl/1/1
>>> to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a         at
>>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
>>> copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
>>> 
>>> ..
>>> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request] (secstorage-
>>> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId: 268749071320359,
>>> via: 12,
>>> Ver: v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
>>> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
>>> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
>>> 74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-
>>> 32bb-94e1-
>>> 
>> 74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,
>>> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
>>> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
>>> 10.10.171.155/export/primary","url":"nfs://
>>> 10.10.171.155/export/secondary/template/tmpl/1/1/","format":"VHD","acco
>>> untId":1,"name":"routing-1","wait":10800}}]
>>> }
>>> 
>>> ..
>>> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
>>> (DirectAgent-244:null) Seq 12-749863191: Processing:  { Ans: , MgmtId:
>>> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
>>> 
>> PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"
>>> Catch
>>> Exception com.cloud.utils.exception.CloudRuntimeException on
>>> host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
>>> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
>>> com.cloud.utils.exception.CloudRuntimeException: can't mount
>>> 10.10.171.155:/export/secondary/template/tmpl/1/1
>>> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
>>> b1e639b9b05a","wait":0}}] }
>>> 
>>> Regards,
>>> Amit
>>> *CloudByte Inc.* <http://www.cloudbyte.com/>
>> 


Re: System VMs not running

Posted by Amit Das <am...@cloudbyte.com>.
Hi,

I have not seeded the secondary storage with system vm template.

The directory ../template/tmpl/1/1 is not present.


Regards,
Amit
*CloudByte Inc.* <http://www.cloudbyte.com/>


On Thu, Aug 22, 2013 at 4:58 PM, Devdeep Singh <de...@citrix.com>wrote:

> Did you seed the secondary storage with the systemvm template before
> starting the setup? If not, can you check if under your secondary storage
> the ../template/tmpl/1/1 directory is present?
>
> Regards,
> Devdeep
>
> > -----Original Message-----
> > From: Amit Das [mailto:amit.das@cloudbyte.com]
> > Sent: Thursday, August 22, 2013 4:50 PM
> > To: dev@cloudstack.apache.org
> > Subject: System VMs not running
> >
> > Hi folks,
> >
> > I am running CloudStack 4.1.1. & running the NFS share on the same box as
> > CloudStack management server (CentOS 6). The hypervisor is a separate Xen
> > server.
> >
> > I am not able to get the system vms in a running state.
> > We had not downloaded the vhd-util initially but it has been downloaded
> now.
> > The management server has been restarted & appropriate rpcbind, nfs
> > services started. The configuration was redone from scratch. However, we
> are
> > stuck with below error always.
> >
> > com.cloud.utils.exception.CloudRuntimeException: can't mount
> > 10.10.171.155:/export/secondary/template/tmpl/1/1
> > to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a         at
> > com.cloud.hypervisor.xen.resource.CitrixResourceBase.
> > copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
> >
> > ..
> > 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request] (secstorage-
> > 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId: 268749071320359,
> > via: 12,
> > Ver: v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
> > ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
> > 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
> > 74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-
> > 32bb-94e1-
> >
> 74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,
> > "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> > 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> > 10.10.171.155/export/primary","url":"nfs://
> > 10.10.171.155/export/secondary/template/tmpl/1/1/","format":"VHD","acco
> > untId":1,"name":"routing-1","wait":10800}}]
> > }
> >
> > ..
> > 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
> > (DirectAgent-244:null) Seq 12-749863191: Processing:  { Ans: , MgmtId:
> > 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> >
> PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"
> > Catch
> > Exception com.cloud.utils.exception.CloudRuntimeException on
> > host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> > 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> > com.cloud.utils.exception.CloudRuntimeException: can't mount
> > 10.10.171.155:/export/secondary/template/tmpl/1/1
> > to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
> > b1e639b9b05a","wait":0}}] }
> >
> > Regards,
> > Amit
> > *CloudByte Inc.* <http://www.cloudbyte.com/>
>

RE: System VMs not running

Posted by Devdeep Singh <de...@citrix.com>.
Did you seed the secondary storage with the systemvm template before starting the setup? If not, can you check if under your secondary storage the ../template/tmpl/1/1 directory is present?

Regards,
Devdeep

> -----Original Message-----
> From: Amit Das [mailto:amit.das@cloudbyte.com]
> Sent: Thursday, August 22, 2013 4:50 PM
> To: dev@cloudstack.apache.org
> Subject: System VMs not running
> 
> Hi folks,
> 
> I am running CloudStack 4.1.1. & running the NFS share on the same box as
> CloudStack management server (CentOS 6). The hypervisor is a separate Xen
> server.
> 
> I am not able to get the system vms in a running state.
> We had not downloaded the vhd-util initially but it has been downloaded now.
> The management server has been restarted & appropriate rpcbind, nfs
> services started. The configuration was redone from scratch. However, we are
> stuck with below error always.
> 
> com.cloud.utils.exception.CloudRuntimeException: can't mount
> 10.10.171.155:/export/secondary/template/tmpl/1/1
> to /var/run/cloud_mount/2cc7d1a3-130b-4ae9-9381-5f8ec6bf751a         at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.
> copy_vhd_from_secondarystorage(CitrixResourceBase.java:2707)
> 
> ..
> 2013-08-22 16:30:52,866 DEBUG [agent.transport.Request] (secstorage-
> 1:null) Seq 12-749863191: Executing:  { Cmd , MgmtId: 268749071320359,
> via: 12,
> Ver: v1, Flags: 100111, [{"storage.*PrimaryStorageDownloadCommand*
> ":{"localPath":"/mnt/15370e0e-c8ae-32bb-94e1-
> 74f1fad0cce3","poolUuid":"15370e0e-c8ae-32bb-94e1-
> 74f1fad0cce3","poolId":211,"primaryPool":{"id":211,"uuid":"15370e0e-c8ae-
> 32bb-94e1-
> 74f1fad0cce3","host":"10.10.171.155","path":"/export/primary","port":2049,
> "type":"NetworkFilesystem"},"secondaryStorageUrl":"nfs://
> 10.10.171.155/export/secondary","primaryStorageUrl":"nfs://
> 10.10.171.155/export/primary","url":"nfs://
> 10.10.171.155/export/secondary/template/tmpl/1/1/","format":"VHD","acco
> untId":1,"name":"routing-1","wait":10800}}]
> }
> 
> ..
> 2013-08-22 16:30:55,128 DEBUG [agent.transport.Request]
> (DirectAgent-244:null) Seq 12-749863191: Processing:  { Ans: , MgmtId:
> 268749071320359, via: 12, Ver: v1, Flags: 110, [{"storage.*
> PrimaryStorageDownloadAnswer*":{"templateSize":0,"result":false,"details":"
> Catch
> Exception com.cloud.utils.exception.CloudRuntimeException on
> host:21318624-cfd9-412d-aeb4-b1418424f287 for template: nfs://
> 10.10.171.155/export/secondary/template/tmpl/1/1/ due to
> com.cloud.utils.exception.CloudRuntimeException: can't mount
> 10.10.171.155:/export/secondary/template/tmpl/1/1
> to /var/run/cloud_mount/60e04e29-8064-4a3f-90c2-
> b1e639b9b05a","wait":0}}] }
> 
> Regards,
> Amit
> *CloudByte Inc.* <http://www.cloudbyte.com/>