You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Indra Pramana <in...@sg.or.id> on 2013/08/12 05:31:43 UTC
Available secondary storage space is low
Dear all,
Anyone knows how CloudStack calculates the capacity of the secondary
storage's space?
My CloudStack 4.1.0 reports that my secondary storage's space is low, even
though it actually has lots of disk space. Problem started to happen after
I changed the secondary storage's NAS from FreeNAS to NAS4Free.
===
2013-08-12 11:20:56,578 DEBUG [cloud.alert.AlertManagerImpl]
(CapacityChecker:null) Available secondary storage space is low, total:
1969 MB, used: 1969 MB (100%)
===
It says I only have 1969 MB, while in fact I have more than 7 TB of disk
space.
Looking forward to your reply, thank you.
Cheers.
Re: Available secondary storage space is low
Posted by Nitin Mehta <Ni...@citrix.com>.
Glad to know that. I added this into the troubleshooting wiki below :)
On 14/08/13 9:30 AM, "Indra Pramana" <in...@sg.or.id> wrote:
>Nitin,
>
>You are correct!
>
>I ran ssvm health check script and found out that the SSVM was not able to
>mount to the secondary storage server. It's due to IP access-list settings
>which was turned on by default on NAS4Free.
>
>Have allowed the SSVM's IP address to mount to the NAS and it's now
>working
>fine.
>
>Thank you! :)
>
>Cheers.
>
>
>On Tue, Aug 13, 2013 at 4:17 PM, Nitin Mehta <Ni...@citrix.com>
>wrote:
>
>> Can you run the ssvm health check script using [1] ? I think your nfs is
>> not correctly mounted or is unrecognized by ssvm.
>>
>> [1]
>>
>>https://cwiki.apache.org/CLOUDSTACK/ssvm-templates-secondary-storage-trou
>>bl
>> eshooting.html
>>
>>
>> On 13/08/13 9:04 AM, "Indra Pramana" <in...@sg.or.id> wrote:
>>
>> >Hi Kirk,
>> >
>> >Good day to you, and thank you for your e-mail.
>> >
>> >We upgraded the NIC to 10GBps and FreeNAS kernel didn't detect the NIC
>> >card, so we switched to NAS4Free and import the existing ZFS pool,
>>which
>> >means the files (templates, etc) are still intact. However, we needed
>>to
>> >change the IP address of the secondary storage server so I used below
>> >method to change the IP address by modifying the MySQL database
>>records:
>> >
>> >http://download.cloud.com/releases/2.2.0/CloudStack2.2.4AdminGuide.pdf
>> >
>> >Page 33, under section 7.3. Changing the Secondary Storage IP Address
>> >
>> >The IP address change was successful and CloudStack recognises the
>> >secondary storage server using its new IP address, even though I
>>needed to
>> >stop and start the SSVM for everything to go back to normal.
>> >
>> >However, the issue comes up and I am not able to download all the
>> >templates
>> >and ISO because CloudStack marks the secondary storage to be out of
>>disk
>> >space (even though there should be a lot of disk space available
>>there).
>> >
>> >When you mentioned mtc mode, are you referring to maintenance mode?
>>There
>> >is no option to put secondary storage in maintenance mode, unlike
>>primary
>> >storage. The only option is to delete the secondary storage. However, I
>> >cannot delete the secondary storage with error message: "Can not delete
>> >this secondary storage since it contains private templates".
>> >
>> >Any advice on how can I resolve this problem?
>> >
>> >Looking forward to your reply, thank you.
>> >
>> >Cheers.
>> >
>> >
>> >On Tue, Aug 13, 2013 at 1:34 AM, Kirk Jantzer
>> ><ki...@gmail.com>wrote:
>> >
>> >> How did you change it? Have you restarted the CS management service
>> >>since
>> >> doing so? Try placing the secondary storage in mtc mode. Then remove
>>the
>> >> mtc mode - it should rescan the available space.
>> >>
>> >>
>> >> On Mon, Aug 12, 2013 at 1:30 PM, Indra Pramana <in...@sg.or.id>
>>wrote:
>> >>
>> >> > Dear all,
>> >> >
>> >> > Anyone can advise? :)
>> >> >
>> >> > Looking forward to your reply, thank you.
>> >> >
>> >> > Cheers.
>> >> >
>> >> >
>> >> > On Mon, Aug 12, 2013 at 11:31 AM, Indra Pramana <in...@sg.or.id>
>> >>wrote:
>> >> >
>> >> > > Dear all,
>> >> > >
>> >> > > Anyone knows how CloudStack calculates the capacity of the
>>secondary
>> >> > > storage's space?
>> >> > >
>> >> > > My CloudStack 4.1.0 reports that my secondary storage's space is
>> >>low,
>> >> > even
>> >> > > though it actually has lots of disk space. Problem started to
>>happen
>> >> > after
>> >> > > I changed the secondary storage's NAS from FreeNAS to NAS4Free.
>> >> > >
>> >> > > ===
>> >> > > 2013-08-12 11:20:56,578 DEBUG [cloud.alert.AlertManagerImpl]
>> >> > > (CapacityChecker:null) Available secondary storage space is low,
>> >>total:
>> >> > > 1969 MB, used: 1969 MB (100%)
>> >> > > ===
>> >> > >
>> >> > > It says I only have 1969 MB, while in fact I have more than 7 TB
>>of
>> >> disk
>> >> > > space.
>> >> > >
>> >> > > Looking forward to your reply, thank you.
>> >> > >
>> >> > > Cheers.
>> >> > >
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Regards,
>> >>
>> >> Kirk Jantzer
>> >> c: (678) 561-5475
>> >> http://about.met/kirkjantzer
>> >>
>>
>>
Re: Available secondary storage space is low
Posted by Indra Pramana <in...@sg.or.id>.
Nitin,
You are correct!
I ran ssvm health check script and found out that the SSVM was not able to
mount to the secondary storage server. It's due to IP access-list settings
which was turned on by default on NAS4Free.
Have allowed the SSVM's IP address to mount to the NAS and it's now working
fine.
Thank you! :)
Cheers.
On Tue, Aug 13, 2013 at 4:17 PM, Nitin Mehta <Ni...@citrix.com> wrote:
> Can you run the ssvm health check script using [1] ? I think your nfs is
> not correctly mounted or is unrecognized by ssvm.
>
> [1]
> https://cwiki.apache.org/CLOUDSTACK/ssvm-templates-secondary-storage-troubl
> eshooting.html
>
>
> On 13/08/13 9:04 AM, "Indra Pramana" <in...@sg.or.id> wrote:
>
> >Hi Kirk,
> >
> >Good day to you, and thank you for your e-mail.
> >
> >We upgraded the NIC to 10GBps and FreeNAS kernel didn't detect the NIC
> >card, so we switched to NAS4Free and import the existing ZFS pool, which
> >means the files (templates, etc) are still intact. However, we needed to
> >change the IP address of the secondary storage server so I used below
> >method to change the IP address by modifying the MySQL database records:
> >
> >http://download.cloud.com/releases/2.2.0/CloudStack2.2.4AdminGuide.pdf
> >
> >Page 33, under section 7.3. Changing the Secondary Storage IP Address
> >
> >The IP address change was successful and CloudStack recognises the
> >secondary storage server using its new IP address, even though I needed to
> >stop and start the SSVM for everything to go back to normal.
> >
> >However, the issue comes up and I am not able to download all the
> >templates
> >and ISO because CloudStack marks the secondary storage to be out of disk
> >space (even though there should be a lot of disk space available there).
> >
> >When you mentioned mtc mode, are you referring to maintenance mode? There
> >is no option to put secondary storage in maintenance mode, unlike primary
> >storage. The only option is to delete the secondary storage. However, I
> >cannot delete the secondary storage with error message: "Can not delete
> >this secondary storage since it contains private templates".
> >
> >Any advice on how can I resolve this problem?
> >
> >Looking forward to your reply, thank you.
> >
> >Cheers.
> >
> >
> >On Tue, Aug 13, 2013 at 1:34 AM, Kirk Jantzer
> ><ki...@gmail.com>wrote:
> >
> >> How did you change it? Have you restarted the CS management service
> >>since
> >> doing so? Try placing the secondary storage in mtc mode. Then remove the
> >> mtc mode - it should rescan the available space.
> >>
> >>
> >> On Mon, Aug 12, 2013 at 1:30 PM, Indra Pramana <in...@sg.or.id> wrote:
> >>
> >> > Dear all,
> >> >
> >> > Anyone can advise? :)
> >> >
> >> > Looking forward to your reply, thank you.
> >> >
> >> > Cheers.
> >> >
> >> >
> >> > On Mon, Aug 12, 2013 at 11:31 AM, Indra Pramana <in...@sg.or.id>
> >>wrote:
> >> >
> >> > > Dear all,
> >> > >
> >> > > Anyone knows how CloudStack calculates the capacity of the secondary
> >> > > storage's space?
> >> > >
> >> > > My CloudStack 4.1.0 reports that my secondary storage's space is
> >>low,
> >> > even
> >> > > though it actually has lots of disk space. Problem started to happen
> >> > after
> >> > > I changed the secondary storage's NAS from FreeNAS to NAS4Free.
> >> > >
> >> > > ===
> >> > > 2013-08-12 11:20:56,578 DEBUG [cloud.alert.AlertManagerImpl]
> >> > > (CapacityChecker:null) Available secondary storage space is low,
> >>total:
> >> > > 1969 MB, used: 1969 MB (100%)
> >> > > ===
> >> > >
> >> > > It says I only have 1969 MB, while in fact I have more than 7 TB of
> >> disk
> >> > > space.
> >> > >
> >> > > Looking forward to your reply, thank you.
> >> > >
> >> > > Cheers.
> >> > >
> >> >
> >>
> >>
> >>
> >> --
> >> Regards,
> >>
> >> Kirk Jantzer
> >> c: (678) 561-5475
> >> http://about.met/kirkjantzer
> >>
>
>
Re: Available secondary storage space is low
Posted by Nitin Mehta <Ni...@citrix.com>.
Can you run the ssvm health check script using [1] ? I think your nfs is
not correctly mounted or is unrecognized by ssvm.
[1]
https://cwiki.apache.org/CLOUDSTACK/ssvm-templates-secondary-storage-troubl
eshooting.html
On 13/08/13 9:04 AM, "Indra Pramana" <in...@sg.or.id> wrote:
>Hi Kirk,
>
>Good day to you, and thank you for your e-mail.
>
>We upgraded the NIC to 10GBps and FreeNAS kernel didn't detect the NIC
>card, so we switched to NAS4Free and import the existing ZFS pool, which
>means the files (templates, etc) are still intact. However, we needed to
>change the IP address of the secondary storage server so I used below
>method to change the IP address by modifying the MySQL database records:
>
>http://download.cloud.com/releases/2.2.0/CloudStack2.2.4AdminGuide.pdf
>
>Page 33, under section 7.3. Changing the Secondary Storage IP Address
>
>The IP address change was successful and CloudStack recognises the
>secondary storage server using its new IP address, even though I needed to
>stop and start the SSVM for everything to go back to normal.
>
>However, the issue comes up and I am not able to download all the
>templates
>and ISO because CloudStack marks the secondary storage to be out of disk
>space (even though there should be a lot of disk space available there).
>
>When you mentioned mtc mode, are you referring to maintenance mode? There
>is no option to put secondary storage in maintenance mode, unlike primary
>storage. The only option is to delete the secondary storage. However, I
>cannot delete the secondary storage with error message: "Can not delete
>this secondary storage since it contains private templates".
>
>Any advice on how can I resolve this problem?
>
>Looking forward to your reply, thank you.
>
>Cheers.
>
>
>On Tue, Aug 13, 2013 at 1:34 AM, Kirk Jantzer
><ki...@gmail.com>wrote:
>
>> How did you change it? Have you restarted the CS management service
>>since
>> doing so? Try placing the secondary storage in mtc mode. Then remove the
>> mtc mode - it should rescan the available space.
>>
>>
>> On Mon, Aug 12, 2013 at 1:30 PM, Indra Pramana <in...@sg.or.id> wrote:
>>
>> > Dear all,
>> >
>> > Anyone can advise? :)
>> >
>> > Looking forward to your reply, thank you.
>> >
>> > Cheers.
>> >
>> >
>> > On Mon, Aug 12, 2013 at 11:31 AM, Indra Pramana <in...@sg.or.id>
>>wrote:
>> >
>> > > Dear all,
>> > >
>> > > Anyone knows how CloudStack calculates the capacity of the secondary
>> > > storage's space?
>> > >
>> > > My CloudStack 4.1.0 reports that my secondary storage's space is
>>low,
>> > even
>> > > though it actually has lots of disk space. Problem started to happen
>> > after
>> > > I changed the secondary storage's NAS from FreeNAS to NAS4Free.
>> > >
>> > > ===
>> > > 2013-08-12 11:20:56,578 DEBUG [cloud.alert.AlertManagerImpl]
>> > > (CapacityChecker:null) Available secondary storage space is low,
>>total:
>> > > 1969 MB, used: 1969 MB (100%)
>> > > ===
>> > >
>> > > It says I only have 1969 MB, while in fact I have more than 7 TB of
>> disk
>> > > space.
>> > >
>> > > Looking forward to your reply, thank you.
>> > >
>> > > Cheers.
>> > >
>> >
>>
>>
>>
>> --
>> Regards,
>>
>> Kirk Jantzer
>> c: (678) 561-5475
>> http://about.met/kirkjantzer
>>
Re: Available secondary storage space is low
Posted by Indra Pramana <in...@sg.or.id>.
Hi Kirk,
Good day to you, and thank you for your e-mail.
We upgraded the NIC to 10GBps and FreeNAS kernel didn't detect the NIC
card, so we switched to NAS4Free and import the existing ZFS pool, which
means the files (templates, etc) are still intact. However, we needed to
change the IP address of the secondary storage server so I used below
method to change the IP address by modifying the MySQL database records:
http://download.cloud.com/releases/2.2.0/CloudStack2.2.4AdminGuide.pdf
Page 33, under section 7.3. Changing the Secondary Storage IP Address
The IP address change was successful and CloudStack recognises the
secondary storage server using its new IP address, even though I needed to
stop and start the SSVM for everything to go back to normal.
However, the issue comes up and I am not able to download all the templates
and ISO because CloudStack marks the secondary storage to be out of disk
space (even though there should be a lot of disk space available there).
When you mentioned mtc mode, are you referring to maintenance mode? There
is no option to put secondary storage in maintenance mode, unlike primary
storage. The only option is to delete the secondary storage. However, I
cannot delete the secondary storage with error message: "Can not delete
this secondary storage since it contains private templates".
Any advice on how can I resolve this problem?
Looking forward to your reply, thank you.
Cheers.
On Tue, Aug 13, 2013 at 1:34 AM, Kirk Jantzer <ki...@gmail.com>wrote:
> How did you change it? Have you restarted the CS management service since
> doing so? Try placing the secondary storage in mtc mode. Then remove the
> mtc mode - it should rescan the available space.
>
>
> On Mon, Aug 12, 2013 at 1:30 PM, Indra Pramana <in...@sg.or.id> wrote:
>
> > Dear all,
> >
> > Anyone can advise? :)
> >
> > Looking forward to your reply, thank you.
> >
> > Cheers.
> >
> >
> > On Mon, Aug 12, 2013 at 11:31 AM, Indra Pramana <in...@sg.or.id> wrote:
> >
> > > Dear all,
> > >
> > > Anyone knows how CloudStack calculates the capacity of the secondary
> > > storage's space?
> > >
> > > My CloudStack 4.1.0 reports that my secondary storage's space is low,
> > even
> > > though it actually has lots of disk space. Problem started to happen
> > after
> > > I changed the secondary storage's NAS from FreeNAS to NAS4Free.
> > >
> > > ===
> > > 2013-08-12 11:20:56,578 DEBUG [cloud.alert.AlertManagerImpl]
> > > (CapacityChecker:null) Available secondary storage space is low, total:
> > > 1969 MB, used: 1969 MB (100%)
> > > ===
> > >
> > > It says I only have 1969 MB, while in fact I have more than 7 TB of
> disk
> > > space.
> > >
> > > Looking forward to your reply, thank you.
> > >
> > > Cheers.
> > >
> >
>
>
>
> --
> Regards,
>
> Kirk Jantzer
> c: (678) 561-5475
> http://about.met/kirkjantzer
>
Re: Available secondary storage space is low
Posted by Kirk Jantzer <ki...@gmail.com>.
How did you change it? Have you restarted the CS management service since
doing so? Try placing the secondary storage in mtc mode. Then remove the
mtc mode - it should rescan the available space.
On Mon, Aug 12, 2013 at 1:30 PM, Indra Pramana <in...@sg.or.id> wrote:
> Dear all,
>
> Anyone can advise? :)
>
> Looking forward to your reply, thank you.
>
> Cheers.
>
>
> On Mon, Aug 12, 2013 at 11:31 AM, Indra Pramana <in...@sg.or.id> wrote:
>
> > Dear all,
> >
> > Anyone knows how CloudStack calculates the capacity of the secondary
> > storage's space?
> >
> > My CloudStack 4.1.0 reports that my secondary storage's space is low,
> even
> > though it actually has lots of disk space. Problem started to happen
> after
> > I changed the secondary storage's NAS from FreeNAS to NAS4Free.
> >
> > ===
> > 2013-08-12 11:20:56,578 DEBUG [cloud.alert.AlertManagerImpl]
> > (CapacityChecker:null) Available secondary storage space is low, total:
> > 1969 MB, used: 1969 MB (100%)
> > ===
> >
> > It says I only have 1969 MB, while in fact I have more than 7 TB of disk
> > space.
> >
> > Looking forward to your reply, thank you.
> >
> > Cheers.
> >
>
--
Regards,
Kirk Jantzer
c: (678) 561-5475
http://about.met/kirkjantzer
Re: Available secondary storage space is low
Posted by Indra Pramana <in...@sg.or.id>.
Dear all,
Anyone can advise? :)
Looking forward to your reply, thank you.
Cheers.
On Mon, Aug 12, 2013 at 11:31 AM, Indra Pramana <in...@sg.or.id> wrote:
> Dear all,
>
> Anyone knows how CloudStack calculates the capacity of the secondary
> storage's space?
>
> My CloudStack 4.1.0 reports that my secondary storage's space is low, even
> though it actually has lots of disk space. Problem started to happen after
> I changed the secondary storage's NAS from FreeNAS to NAS4Free.
>
> ===
> 2013-08-12 11:20:56,578 DEBUG [cloud.alert.AlertManagerImpl]
> (CapacityChecker:null) Available secondary storage space is low, total:
> 1969 MB, used: 1969 MB (100%)
> ===
>
> It says I only have 1969 MB, while in fact I have more than 7 TB of disk
> space.
>
> Looking forward to your reply, thank you.
>
> Cheers.
>