You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Milamber <mi...@apache.org> on 2016/01/24 00:49:15 UTC
Re: Issue with VR after upgrade to 4.6.2
Hello,
I've have a similiar issue without solution (but not with an upgrade
from 4.5), please see
https://issues.apache.org/jira/browse/CLOUDSTACK-9255
Milamber
On 24/01/2016 03:32, Daniel Mezentsev wrote:
> Hi All,
>
> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
> Environment has 8 VR, 6 were upgraded and restarted successfully, 2 of
> them
> stuck. I removed them - the same result, i can't boot them, restarted
> network with clean-up - no luck.
> VR actually is starting, i can ssh to it, but it's shuting down in
> approx 5
> minutes. I can extend it runing
> "init 3" command, but cloudstack is not detecting router state.
>
> I can bing some VMs within the same subnet, so it's not VLAN/network
> issue.
>
> Completely ran out of ideas.
> Should mention network offering is Isolated network without NAT.
>
> Any help is more then welcome. I can provide any related log, but i need
> some heads-up what i should look for.
> Daniel Mezentsev, founder
> (+1) 604 313 8592.
> Soleks Data Group.
> Shaping the clouds.
>
Re: Issue with VR after upgrade to 4.6.2
Posted by Milamber <mi...@apache.org>.
Hello Remi,
I've tested with router.aggregation.command.each.timeout global set to
20 without success: same issue (kill in around 5-7 min after the restart
command)
and with 3600 sec : same issue (kill)
(on 4.7.1 RC fresh install)
Milamber
On 24/01/2016 06:57, Remi Bergsma wrote:
> Hi,
>
> We have seen this issue sometimes in the VRs from 4.6 and on. There have been several improvements in the code in 4.7.
>
> Also, setting router.aggregation.command.each.timeout global setting to 15 or 20 also may help (restart mgt server after change).
>
> @Milamber can you test this setting with 4.7.1RC please? I haven't seen this issue in my test and production systems.
>
> Thanks, Remi
>
> Sent from my iPhone
>
>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>
>>
>> Hello,
>>
>> I've have a similiar issue without solution (but not with an upgrade from 4.5), please see
>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>
>> Milamber
>>
>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>> Hi All,
>>>
>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>> Environment has 8 VR, 6 were upgraded and restarted successfully, 2 of them
>>> stuck. I removed them - the same result, i can't boot them, restarted
>>> network with clean-up - no luck.
>>> VR actually is starting, i can ssh to it, but it's shuting down in approx 5
>>> minutes. I can extend it runing
>>> "init 3" command, but cloudstack is not detecting router state.
>>>
>>> I can bing some VMs within the same subnet, so it's not VLAN/network issue.
>>>
>>> Completely ran out of ideas.
>>> Should mention network offering is Isolated network without NAT.
>>>
>>> Any help is more then welcome. I can provide any related log, but i need
>>> some heads-up what i should look for.
>>> Daniel Mezentsev, founder
>>> (+1) 604 313 8592.
>>> Soleks Data Group.
>>> Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Remi Bergsma <RB...@schubergphilis.com>.
This means that (at least) one of the commands that are sent takes a much longer time than expected. At least it works now.
Jayapal refers to the management server logs. The reason might be in there, or else in the cloud.log on the router.
Regards, Remi
Sent from my iPhone
> On 28 Jan 2016, at 07:33, Daniel Mezentsev <da...@.com> wrote:
>
> Increased settings to 60. Got VR(s) up and running.
> Interesting.
>
>> Hi Daniel,
>>
>> Can you please bump that setting to 15 or 20 and restart mgt server?
>> Then start the router again.
>>
>> Let me know!
>>
>> Regards, Remi
>>
>> Sent from my iPhone
>>
>>> On 28 Jan 2016, at 07:00, Daniel Mezentsev <da...@soleks.com> wrote:
>>>
>>> Hi Remi,
>>>
>>> Setup is the following
>>> Cloudstack 4.7.1
>>> One cluster of XenServers (6.2) - 4 hosts
>>> Advanced network
>>> That 2 routers i have problems with are just DNS and DHCP providers,
> they
>>> are not actibe as default gateway for VMs,
>>> there are ~10-12 VMs.
>>>
>>> router.aggregation.command.each.timeout=3
>>>
>>>> Hi Daniel,
>>>>
>>>> At what value is router.aggregation.command.each.timeout global
> setting?
>>>>
>>>> Can you tell a bit about your setup, what the router does (config) as
> in
>>>> how many VMs, tiers, public IPs etc.
>>>>
>>>> Regards, Remi
>>>>
>>>> Sent from my iPhone
>>>>
>>>>> On 28 Jan 2016, at 05:18, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>
>>>>> Hi Remi,
>>>>>
>>>>> I just upgraded 4.6.2->4.7.1 The same issue, unable to start 2 VRs
> (out
>>>>> of
>>>>> 8 total). VR actually is started, running for 5-7 minutes, then
> shuting
>>>>> down. One thing that i noticed in the log:
>>>>>
>>>>> arping -c 1 -I eth0 -A -U -s 10.1.12.1 None
>>>>>
>>>>> What is "None" here ?
>>>>>
>>>>> Please let me know what information from the log can i provide you to
>>>>> help
>>>>> with troubleshooting. I noticed that there are a lot of the same
> issues
>>>>> happened after upgrade to 4.6, seems like it's getting critical.
>>>>>
>>>>>> No, just the same template so it's just a matter of upgrading
> package.
>>>>>> Will ping you when the release is ready.
>>>>>>
>>>>>> Regards, Remi
>>>>>>
>>>>>> Sent from my iPhone
>>>>>>
>>>>>>> On 25 Jan 2016, at 21:41, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>>>
>>>>>>> Hi Remi,
>>>>>>>
>>>>>>> Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be
>>>>>
>>>>> with
>>>>>>> new templates for system VMs ?
>>>>>>>
>>>>>>>> Hi Daniel,
>>>>>>>>
>>>>>>>> Is upgrading to 4.7.1 (once released tomorrow) an option? It has
>>>>>>>> many
>>>>>>>> improvements over 4.6.x and I'm quite sure it fixes the problem you
>>>>>>>> experience now.
>>>>>>>>
>>>>>>>> Regards, Remi
>>>>>>>>
>>>>>>>> Sent from my iPhone
>>>>>>>>
>>>>>>>>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>>>>>
>>>>>>>>> in my configuration VR is acting as DHCP/DNS server, so it's not
>>>>>>>>> passing
>>>>>>>>> any traffic, so i can exclude public IP addresses. Definetely
> there
>>>>>>>>> is
>>>>>>>>> one
>>>>>>>>> of the VR script is acting badly.
>>>>>>>>>
>>>>>>>>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep
>>>
>>> 20
>>>>>>> vms
>>>>>>>>>> associated with the network), the network (virtual router)
> restart
>>>>>>>>>> with
>>>>>>>>>> clean up successfully (around in 3 min).
>>>>>>>>>> I thinks that is a timeout problem (or VR scripts performance)...
>>>>>>>>>> but
>>>>>>>>>> which timeout parameter?
>>>>>>>>>>
>>>>>>>>>>> On 24/01/2016 09:43, Milamber wrote:
>>>>>>>>>>> Please note, my installation type is Advanced network without
>>>>>>>>>>> security
>>>>>>>>>>> groups (vlan isolation).
>>>>>>>>>>>
>>>>>>>>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>>>>>>>>> Hi,
>>>>>>>>>>>>
>>>>>>>>>>>> We have seen this issue sometimes in the VRs from 4.6 and on.
>>>>>>>>>>>> There
>>>>>>>>>>>> have been several improvements in the code in 4.7.
>>>>>>>>>>>>
>>>>>>>>>>>> Also, setting router.aggregation.command.each.timeout global
>>>>>
>>>>> setting
>>>>>>>>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>>>>>>>>
>>>>>>>>>>>> @Milamber can you test this setting with 4.7.1RC please? I
>>>
>>> haven't
>>>>>>>>>>>> seen this issue in my test and production systems.
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks, Remi
>>>>>>>>>>>>
>>>>>>>>>>>> Sent from my iPhone
>>>>>>>>>>>>
>>>>>>>>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org>
> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>> Hello,
>>>>>>>>>>>>>
>>>>>>>>>>>>> I've have a similiar issue without solution (but not with an
>>>>>>>>>>>>> upgrade
>>>>>>>>>>>>> from 4.5), please see
>>>>>>>>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>>>>>>>>
>>>>>>>>>>>>> Milamber
>>>>>>>>>>>>>
>>>>>>>>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 ->
>>>
>>> 4.6.2.
>>>>>>>>>>>>>> Environment has 8 VR, 6 were upgraded and restarted
>>>>>>>>>>>>>> successfully, 2
>>>>>>>>>>>>>> of them
>>>>>>>>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>>>>>>>>> restarted
>>>>>>>>>>>>>> network with clean-up - no luck.
>>>>>>>>>>>>>> VR actually is starting, i can ssh to it, but it's shuting
>>>>>>>>>>>>>> down
>>>>>
>>>>> in
>>>>>>>>>>>>>> approx 5
>>>>>>>>>>>>>> minutes. I can extend it runing
>>>>>>>>>>>>>> "init 3" command, but cloudstack is not detecting router
>>>>>>>>>>>>>> state.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I can bing some VMs within the same subnet, so it's not
>>>>>>>
>>>>>>> VLAN/network
>>>>>>>>>>>>>> issue.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Completely ran out of ideas.
>>>>>>>>>>>>>> Should mention network offering is Isolated network without
>>>
>>> NAT.
>>>>>>>>>>>>>> Any help is more then welcome. I can provide any related log,
>>>>>>>>>>>>>> but i
>>>>>>>>>>>>>> need
>>>>>>>>>>>>>> some heads-up what i should look for.
>>>>>>>>>>>>>> Daniel Mezentsev, founder
>>>>>>>>>>>>>> (+1) 604 313 8592.
>>>>>>>>>>>>>> Soleks Data Group.
>>>>>>>>>>>>>> Shaping the clouds.
>>>>>>>>>
>>>>>>>>> Daniel Mezentsev, founder
>>>>>>>>> (+1) 604 313 8592.
>>>>>>>>> Soleks Data Group.Shaping the clouds.
>>>>>>>
>>>>>>> Daniel Mezentsev, founder
>>>>>>> (+1) 604 313 8592.
>>>>>>> Soleks Data Group.Shaping the clouds.
>>>>>
>>>>> Daniel Mezentsev, founder
>>>>> (+1) 604 313 8592.
>>>>> Soleks Data Group.Shaping the clouds.
>>>
>>> Daniel Mezentsev, founder
>>> (+1) 604 313 8592.
>>> Soleks Data Group.Shaping the clouds.
> Daniel Mezentsev, founder
> (+1) 604 313 8592.
> Soleks Data Group.
> Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Daniel Mezentsev <da...@soleks.com>.
Increased settings to 60. Got VR(s) up and running.
Interesting.
> Hi Daniel,
>
> Can you please bump that setting to 15 or 20 and restart mgt server?
> Then start the router again.
>
> Let me know!
>
> Regards, Remi
>
> Sent from my iPhone
>
>> On 28 Jan 2016, at 07:00, Daniel Mezentsev <da...@soleks.com> wrote:
>>
>> Hi Remi,
>>
>> Setup is the following
>> Cloudstack 4.7.1
>> One cluster of XenServers (6.2) - 4 hosts
>> Advanced network
>> That 2 routers i have problems with are just DNS and DHCP providers,
they
>> are not actibe as default gateway for VMs,
>> there are ~10-12 VMs.
>>
>> router.aggregation.command.each.timeout=3
>>
>>> Hi Daniel,
>>>
>>> At what value is router.aggregation.command.each.timeout global
setting?
>>>
>>> Can you tell a bit about your setup, what the router does (config) as
in
>>> how many VMs, tiers, public IPs etc.
>>>
>>> Regards, Remi
>>>
>>> Sent from my iPhone
>>>
>>>> On 28 Jan 2016, at 05:18, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>
>>>> Hi Remi,
>>>>
>>>> I just upgraded 4.6.2->4.7.1 The same issue, unable to start 2 VRs
(out
>>>> of
>>>> 8 total). VR actually is started, running for 5-7 minutes, then
shuting
>>>> down. One thing that i noticed in the log:
>>>>
>>>> arping -c 1 -I eth0 -A -U -s 10.1.12.1 None
>>>>
>>>> What is "None" here ?
>>>>
>>>> Please let me know what information from the log can i provide you to
>>>> help
>>>> with troubleshooting. I noticed that there are a lot of the same
issues
>>>> happened after upgrade to 4.6, seems like it's getting critical.
>>>>
>>>>> No, just the same template so it's just a matter of upgrading
package.
>>>>> Will ping you when the release is ready.
>>>>>
>>>>> Regards, Remi
>>>>>
>>>>> Sent from my iPhone
>>>>>
>>>>>> On 25 Jan 2016, at 21:41, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>>
>>>>>> Hi Remi,
>>>>>>
>>>>>> Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be
>>>>
>>>> with
>>>>>> new templates for system VMs ?
>>>>>>
>>>>>>> Hi Daniel,
>>>>>>>
>>>>>>> Is upgrading to 4.7.1 (once released tomorrow) an option? It has
>>>>>>> many
>>>>>>> improvements over 4.6.x and I'm quite sure it fixes the problem you
>>>>>>> experience now.
>>>>>>>
>>>>>>> Regards, Remi
>>>>>>>
>>>>>>> Sent from my iPhone
>>>>>>>
>>>>>>>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>>>>
>>>>>>>> in my configuration VR is acting as DHCP/DNS server, so it's not
>>>>>>>> passing
>>>>>>>> any traffic, so i can exclude public IP addresses. Definetely
there
>>>>>>>> is
>>>>>>>> one
>>>>>>>> of the VR script is acting badly.
>>>>>>>>
>>>>>>>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep
>>
>> 20
>>>>>> vms
>>>>>>>>> associated with the network), the network (virtual router)
restart
>>>>>>>>> with
>>>>>>>>> clean up successfully (around in 3 min).
>>>>>>>>> I thinks that is a timeout problem (or VR scripts performance)...
>>>>>>>>> but
>>>>>>>>> which timeout parameter?
>>>>>>>>>
>>>>>>>>>> On 24/01/2016 09:43, Milamber wrote:
>>>>>>>>>> Please note, my installation type is Advanced network without
>>>>>>>>>> security
>>>>>>>>>> groups (vlan isolation).
>>>>>>>>>>
>>>>>>>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> We have seen this issue sometimes in the VRs from 4.6 and on.
>>>>>>>>>>> There
>>>>>>>>>>> have been several improvements in the code in 4.7.
>>>>>>>>>>>
>>>>>>>>>>> Also, setting router.aggregation.command.each.timeout global
>>>>
>>>> setting
>>>>>>>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>>>>>>>
>>>>>>>>>>> @Milamber can you test this setting with 4.7.1RC please? I
>>
>> haven't
>>>>>>>>>>> seen this issue in my test and production systems.
>>>>>>>>>>>
>>>>>>>>>>> Thanks, Remi
>>>>>>>>>>>
>>>>>>>>>>> Sent from my iPhone
>>>>>>>>>>>
>>>>>>>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org>
wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> Hello,
>>>>>>>>>>>>
>>>>>>>>>>>> I've have a similiar issue without solution (but not with an
>>>>>>>>>>>> upgrade
>>>>>>>>>>>> from 4.5), please see
>>>>>>>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>>>>>>>
>>>>>>>>>>>> Milamber
>>>>>>>>>>>>
>>>>>>>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>
>>>>>>>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 ->
>>
>> 4.6.2.
>>>>>>>>>>>>> Environment has 8 VR, 6 were upgraded and restarted
>>>>>>>>>>>>> successfully, 2
>>>>>>>>>>>>> of them
>>>>>>>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>>>>>>>> restarted
>>>>>>>>>>>>> network with clean-up - no luck.
>>>>>>>>>>>>> VR actually is starting, i can ssh to it, but it's shuting
>>>>>>>>>>>>> down
>>>>
>>>> in
>>>>>>>>>>>>> approx 5
>>>>>>>>>>>>> minutes. I can extend it runing
>>>>>>>>>>>>> "init 3" command, but cloudstack is not detecting router
>>>>>>>>>>>>> state.
>>>>>>>>>>>>>
>>>>>>>>>>>>> I can bing some VMs within the same subnet, so it's not
>>>>>>
>>>>>> VLAN/network
>>>>>>>>>>>>> issue.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Completely ran out of ideas.
>>>>>>>>>>>>> Should mention network offering is Isolated network without
>>
>> NAT.
>>>>>>>>>>>>> Any help is more then welcome. I can provide any related log,
>>>>>>>>>>>>> but i
>>>>>>>>>>>>> need
>>>>>>>>>>>>> some heads-up what i should look for.
>>>>>>>>>>>>> Daniel Mezentsev, founder
>>>>>>>>>>>>> (+1) 604 313 8592.
>>>>>>>>>>>>> Soleks Data Group.
>>>>>>>>>>>>> Shaping the clouds.
>>>>>>>>
>>>>>>>> Daniel Mezentsev, founder
>>>>>>>> (+1) 604 313 8592.
>>>>>>>> Soleks Data Group.Shaping the clouds.
>>>>>>
>>>>>> Daniel Mezentsev, founder
>>>>>> (+1) 604 313 8592.
>>>>>> Soleks Data Group.Shaping the clouds.
>>>>
>>>> Daniel Mezentsev, founder
>>>> (+1) 604 313 8592.
>>>> Soleks Data Group.Shaping the clouds.
>>
>> Daniel Mezentsev, founder
>> (+1) 604 313 8592.
>> Soleks Data Group.Shaping the clouds.
>
>
Daniel Mezentsev, founder
(+1) 604 313 8592.
Soleks Data Group.
Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Remi Bergsma <RB...@schubergphilis.com>.
Hi Daniel,
Can you please bump that setting to 15 or 20 and restart mgt server? Then start the router again.
Let me know!
Regards, Remi
Sent from my iPhone
> On 28 Jan 2016, at 07:00, Daniel Mezentsev <da...@soleks.com> wrote:
>
> Hi Remi,
>
> Setup is the following
> Cloudstack 4.7.1
> One cluster of XenServers (6.2) - 4 hosts
> Advanced network
> That 2 routers i have problems with are just DNS and DHCP providers, they
> are not actibe as default gateway for VMs,
> there are ~10-12 VMs.
>
> router.aggregation.command.each.timeout=3
>
>> Hi Daniel,
>>
>> At what value is router.aggregation.command.each.timeout global setting?
>>
>> Can you tell a bit about your setup, what the router does (config) as in
>> how many VMs, tiers, public IPs etc.
>>
>> Regards, Remi
>>
>> Sent from my iPhone
>>
>>> On 28 Jan 2016, at 05:18, Daniel Mezentsev <da...@soleks.com> wrote:
>>>
>>> Hi Remi,
>>>
>>> I just upgraded 4.6.2->4.7.1 The same issue, unable to start 2 VRs (out
>>> of
>>> 8 total). VR actually is started, running for 5-7 minutes, then shuting
>>> down. One thing that i noticed in the log:
>>>
>>> arping -c 1 -I eth0 -A -U -s 10.1.12.1 None
>>>
>>> What is "None" here ?
>>>
>>> Please let me know what information from the log can i provide you to
>>> help
>>> with troubleshooting. I noticed that there are a lot of the same issues
>>> happened after upgrade to 4.6, seems like it's getting critical.
>>>
>>>> No, just the same template so it's just a matter of upgrading package.
>>>> Will ping you when the release is ready.
>>>>
>>>> Regards, Remi
>>>>
>>>> Sent from my iPhone
>>>>
>>>>> On 25 Jan 2016, at 21:41, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>
>>>>> Hi Remi,
>>>>>
>>>>> Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be
>>>
>>> with
>>>>> new templates for system VMs ?
>>>>>
>>>>>> Hi Daniel,
>>>>>>
>>>>>> Is upgrading to 4.7.1 (once released tomorrow) an option? It has many
>>>>>> improvements over 4.6.x and I'm quite sure it fixes the problem you
>>>>>> experience now.
>>>>>>
>>>>>> Regards, Remi
>>>>>>
>>>>>> Sent from my iPhone
>>>>>>
>>>>>>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>>>
>>>>>>> in my configuration VR is acting as DHCP/DNS server, so it's not
>>>>>>> passing
>>>>>>> any traffic, so i can exclude public IP addresses. Definetely there
>>>>>>> is
>>>>>>> one
>>>>>>> of the VR script is acting badly.
>>>>>>>
>>>>>>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep
> 20
>>>>>
>>>>> vms
>>>>>>>> associated with the network), the network (virtual router) restart
>>>>>>>> with
>>>>>>>> clean up successfully (around in 3 min).
>>>>>>>> I thinks that is a timeout problem (or VR scripts performance)...
>>>>>>>> but
>>>>>>>> which timeout parameter?
>>>>>>>>
>>>>>>>>> On 24/01/2016 09:43, Milamber wrote:
>>>>>>>>> Please note, my installation type is Advanced network without
>>>>>>>>> security
>>>>>>>>> groups (vlan isolation).
>>>>>>>>>
>>>>>>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> We have seen this issue sometimes in the VRs from 4.6 and on.
>>>>>>>>>> There
>>>>>>>>>> have been several improvements in the code in 4.7.
>>>>>>>>>>
>>>>>>>>>> Also, setting router.aggregation.command.each.timeout global
>>>
>>> setting
>>>>>>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>>>>>>
>>>>>>>>>> @Milamber can you test this setting with 4.7.1RC please? I
> haven't
>>>>>>>>>> seen this issue in my test and production systems.
>>>>>>>>>>
>>>>>>>>>> Thanks, Remi
>>>>>>>>>>
>>>>>>>>>> Sent from my iPhone
>>>>>>>>>>
>>>>>>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>>>>>>>>
>>>>>>>>>>> Hello,
>>>>>>>>>>>
>>>>>>>>>>> I've have a similiar issue without solution (but not with an
>>>>>>>>>>> upgrade
>>>>>>>>>>> from 4.5), please see
>>>>>>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>>>>>>
>>>>>>>>>>> Milamber
>>>>>>>>>>>
>>>>>>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>
>>>>>>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 ->
> 4.6.2.
>>>>>>>>>>>> Environment has 8 VR, 6 were upgraded and restarted
>>>>>>>>>>>> successfully, 2
>>>>>>>>>>>> of them
>>>>>>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>>>>>>> restarted
>>>>>>>>>>>> network with clean-up - no luck.
>>>>>>>>>>>> VR actually is starting, i can ssh to it, but it's shuting down
>>>
>>> in
>>>>>>>>>>>> approx 5
>>>>>>>>>>>> minutes. I can extend it runing
>>>>>>>>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>>>>>>>>
>>>>>>>>>>>> I can bing some VMs within the same subnet, so it's not
>>>>>
>>>>> VLAN/network
>>>>>>>>>>>> issue.
>>>>>>>>>>>>
>>>>>>>>>>>> Completely ran out of ideas.
>>>>>>>>>>>> Should mention network offering is Isolated network without
> NAT.
>>>>>>>>>>>>
>>>>>>>>>>>> Any help is more then welcome. I can provide any related log,
>>>>>>>>>>>> but i
>>>>>>>>>>>> need
>>>>>>>>>>>> some heads-up what i should look for.
>>>>>>>>>>>> Daniel Mezentsev, founder
>>>>>>>>>>>> (+1) 604 313 8592.
>>>>>>>>>>>> Soleks Data Group.
>>>>>>>>>>>> Shaping the clouds.
>>>>>>>
>>>>>>> Daniel Mezentsev, founder
>>>>>>> (+1) 604 313 8592.
>>>>>>> Soleks Data Group.Shaping the clouds.
>>>>>
>>>>> Daniel Mezentsev, founder
>>>>> (+1) 604 313 8592.
>>>>> Soleks Data Group.Shaping the clouds.
>>>
>>> Daniel Mezentsev, founder
>>> (+1) 604 313 8592.
>>> Soleks Data Group.Shaping the clouds.
> Daniel Mezentsev, founder
> (+1) 604 313 8592.
> Soleks Data Group.
> Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Daniel Mezentsev <da...@soleks.com>.
Hi Remi,
Setup is the following
Cloudstack 4.7.1
One cluster of XenServers (6.2) - 4 hosts
Advanced network
That 2 routers i have problems with are just DNS and DHCP providers, they
are not actibe as default gateway for VMs,
there are ~10-12 VMs.
router.aggregation.command.each.timeout=3
> Hi Daniel,
>
> At what value is router.aggregation.command.each.timeout global setting?
>
> Can you tell a bit about your setup, what the router does (config) as in
> how many VMs, tiers, public IPs etc.
>
> Regards, Remi
>
> Sent from my iPhone
>
>> On 28 Jan 2016, at 05:18, Daniel Mezentsev <da...@soleks.com> wrote:
>>
>> Hi Remi,
>>
>> I just upgraded 4.6.2->4.7.1 The same issue, unable to start 2 VRs (out
>> of
>> 8 total). VR actually is started, running for 5-7 minutes, then shuting
>> down. One thing that i noticed in the log:
>>
>> arping -c 1 -I eth0 -A -U -s 10.1.12.1 None
>>
>> What is "None" here ?
>>
>> Please let me know what information from the log can i provide you to
>> help
>> with troubleshooting. I noticed that there are a lot of the same issues
>> happened after upgrade to 4.6, seems like it's getting critical.
>>
>>> No, just the same template so it's just a matter of upgrading package.
>>> Will ping you when the release is ready.
>>>
>>> Regards, Remi
>>>
>>> Sent from my iPhone
>>>
>>>> On 25 Jan 2016, at 21:41, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>
>>>> Hi Remi,
>>>>
>>>> Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be
>>
>> with
>>>> new templates for system VMs ?
>>>>
>>>>> Hi Daniel,
>>>>>
>>>>> Is upgrading to 4.7.1 (once released tomorrow) an option? It has many
>>>>> improvements over 4.6.x and I'm quite sure it fixes the problem you
>>>>> experience now.
>>>>>
>>>>> Regards, Remi
>>>>>
>>>>> Sent from my iPhone
>>>>>
>>>>>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>>
>>>>>> in my configuration VR is acting as DHCP/DNS server, so it's not
>>>>>> passing
>>>>>> any traffic, so i can exclude public IP addresses. Definetely there
>>>>>> is
>>>>>> one
>>>>>> of the VR script is acting badly.
>>>>>>
>>>>>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep
20
>>>>
>>>> vms
>>>>>>> associated with the network), the network (virtual router) restart
>>>>>>> with
>>>>>>> clean up successfully (around in 3 min).
>>>>>>> I thinks that is a timeout problem (or VR scripts performance)...
>>>>>>> but
>>>>>>> which timeout parameter?
>>>>>>>
>>>>>>>> On 24/01/2016 09:43, Milamber wrote:
>>>>>>>> Please note, my installation type is Advanced network without
>>>>>>>> security
>>>>>>>> groups (vlan isolation).
>>>>>>>>
>>>>>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> We have seen this issue sometimes in the VRs from 4.6 and on.
>>>>>>>>> There
>>>>>>>>> have been several improvements in the code in 4.7.
>>>>>>>>>
>>>>>>>>> Also, setting router.aggregation.command.each.timeout global
>>
>> setting
>>>>>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>>>>>
>>>>>>>>> @Milamber can you test this setting with 4.7.1RC please? I
haven't
>>>>>>>>> seen this issue in my test and production systems.
>>>>>>>>>
>>>>>>>>> Thanks, Remi
>>>>>>>>>
>>>>>>>>> Sent from my iPhone
>>>>>>>>>
>>>>>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>>>>>>>
>>>>>>>>>> Hello,
>>>>>>>>>>
>>>>>>>>>> I've have a similiar issue without solution (but not with an
>>>>>>>>>> upgrade
>>>>>>>>>> from 4.5), please see
>>>>>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>>>>>
>>>>>>>>>> Milamber
>>>>>>>>>>
>>>>>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>>>>>> Hi All,
>>>>>>>>>>>
>>>>>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 ->
4.6.2.
>>>>>>>>>>> Environment has 8 VR, 6 were upgraded and restarted
>>>>>>>>>>> successfully, 2
>>>>>>>>>>> of them
>>>>>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>>>>>> restarted
>>>>>>>>>>> network with clean-up - no luck.
>>>>>>>>>>> VR actually is starting, i can ssh to it, but it's shuting down
>>
>> in
>>>>>>>>>>> approx 5
>>>>>>>>>>> minutes. I can extend it runing
>>>>>>>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>>>>>>>
>>>>>>>>>>> I can bing some VMs within the same subnet, so it's not
>>>>
>>>> VLAN/network
>>>>>>>>>>> issue.
>>>>>>>>>>>
>>>>>>>>>>> Completely ran out of ideas.
>>>>>>>>>>> Should mention network offering is Isolated network without
NAT.
>>>>>>>>>>>
>>>>>>>>>>> Any help is more then welcome. I can provide any related log,
>>>>>>>>>>> but i
>>>>>>>>>>> need
>>>>>>>>>>> some heads-up what i should look for.
>>>>>>>>>>> Daniel Mezentsev, founder
>>>>>>>>>>> (+1) 604 313 8592.
>>>>>>>>>>> Soleks Data Group.
>>>>>>>>>>> Shaping the clouds.
>>>>>>
>>>>>> Daniel Mezentsev, founder
>>>>>> (+1) 604 313 8592.
>>>>>> Soleks Data Group.Shaping the clouds.
>>>>
>>>> Daniel Mezentsev, founder
>>>> (+1) 604 313 8592.
>>>> Soleks Data Group.Shaping the clouds.
>>
>> Daniel Mezentsev, founder
>> (+1) 604 313 8592.
>> Soleks Data Group.Shaping the clouds.
>
>
Daniel Mezentsev, founder
(+1) 604 313 8592.
Soleks Data Group.
Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Remi Bergsma <RB...@schubergphilis.com>.
Hi Daniel,
At what value is router.aggregation.command.each.timeout global setting?
Can you tell a bit about your setup, what the router does (config) as in how many VMs, tiers, public IPs etc.
Regards, Remi
Sent from my iPhone
> On 28 Jan 2016, at 05:18, Daniel Mezentsev <da...@soleks.com> wrote:
>
> Hi Remi,
>
> I just upgraded 4.6.2->4.7.1 The same issue, unable to start 2 VRs (out of
> 8 total). VR actually is started, running for 5-7 minutes, then shuting
> down. One thing that i noticed in the log:
>
> arping -c 1 -I eth0 -A -U -s 10.1.12.1 None
>
> What is "None" here ?
>
> Please let me know what information from the log can i provide you to help
> with troubleshooting. I noticed that there are a lot of the same issues
> happened after upgrade to 4.6, seems like it's getting critical.
>
>> No, just the same template so it's just a matter of upgrading package.
>> Will ping you when the release is ready.
>>
>> Regards, Remi
>>
>> Sent from my iPhone
>>
>>> On 25 Jan 2016, at 21:41, Daniel Mezentsev <da...@soleks.com> wrote:
>>>
>>> Hi Remi,
>>>
>>> Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be
> with
>>> new templates for system VMs ?
>>>
>>>> Hi Daniel,
>>>>
>>>> Is upgrading to 4.7.1 (once released tomorrow) an option? It has many
>>>> improvements over 4.6.x and I'm quite sure it fixes the problem you
>>>> experience now.
>>>>
>>>> Regards, Remi
>>>>
>>>> Sent from my iPhone
>>>>
>>>>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>
>>>>> in my configuration VR is acting as DHCP/DNS server, so it's not
>>>>> passing
>>>>> any traffic, so i can exclude public IP addresses. Definetely there is
>>>>> one
>>>>> of the VR script is acting badly.
>>>>>
>>>>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep 20
>>>
>>> vms
>>>>>> associated with the network), the network (virtual router) restart
>>>>>> with
>>>>>> clean up successfully (around in 3 min).
>>>>>> I thinks that is a timeout problem (or VR scripts performance)... but
>>>>>> which timeout parameter?
>>>>>>
>>>>>>> On 24/01/2016 09:43, Milamber wrote:
>>>>>>> Please note, my installation type is Advanced network without
>>>>>>> security
>>>>>>> groups (vlan isolation).
>>>>>>>
>>>>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> We have seen this issue sometimes in the VRs from 4.6 and on. There
>>>>>>>> have been several improvements in the code in 4.7.
>>>>>>>>
>>>>>>>> Also, setting router.aggregation.command.each.timeout global
> setting
>>>>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>>>>
>>>>>>>> @Milamber can you test this setting with 4.7.1RC please? I haven't
>>>>>>>> seen this issue in my test and production systems.
>>>>>>>>
>>>>>>>> Thanks, Remi
>>>>>>>>
>>>>>>>> Sent from my iPhone
>>>>>>>>
>>>>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>>>>>>
>>>>>>>>> Hello,
>>>>>>>>>
>>>>>>>>> I've have a similiar issue without solution (but not with an
>>>>>>>>> upgrade
>>>>>>>>> from 4.5), please see
>>>>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>>>>
>>>>>>>>> Milamber
>>>>>>>>>
>>>>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>>>>> Hi All,
>>>>>>>>>>
>>>>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>>>>>>>>> Environment has 8 VR, 6 were upgraded and restarted
>>>>>>>>>> successfully, 2
>>>>>>>>>> of them
>>>>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>>>>> restarted
>>>>>>>>>> network with clean-up - no luck.
>>>>>>>>>> VR actually is starting, i can ssh to it, but it's shuting down
> in
>>>>>>>>>> approx 5
>>>>>>>>>> minutes. I can extend it runing
>>>>>>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>>>>>>
>>>>>>>>>> I can bing some VMs within the same subnet, so it's not
>>>
>>> VLAN/network
>>>>>>>>>> issue.
>>>>>>>>>>
>>>>>>>>>> Completely ran out of ideas.
>>>>>>>>>> Should mention network offering is Isolated network without NAT.
>>>>>>>>>>
>>>>>>>>>> Any help is more then welcome. I can provide any related log,
>>>>>>>>>> but i
>>>>>>>>>> need
>>>>>>>>>> some heads-up what i should look for.
>>>>>>>>>> Daniel Mezentsev, founder
>>>>>>>>>> (+1) 604 313 8592.
>>>>>>>>>> Soleks Data Group.
>>>>>>>>>> Shaping the clouds.
>>>>>
>>>>> Daniel Mezentsev, founder
>>>>> (+1) 604 313 8592.
>>>>> Soleks Data Group.Shaping the clouds.
>>>
>>> Daniel Mezentsev, founder
>>> (+1) 604 313 8592.
>>> Soleks Data Group.Shaping the clouds.
> Daniel Mezentsev, founder
> (+1) 604 313 8592.
> Soleks Data Group.
> Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Daniel Mezentsev <da...@soleks.com>.
Jaqyapal,
Can you please gimme heads up what is MS ?
setting router.aggregation.command.each.timeout=60 solved issue.
> Hi Daniel,
>
> Please share the MS logs when the VR is going down.
> I want to check, Is MS bringing down the VR ? or VR is getting
> rebooted itself.
>
> Thanks,
> Jaqyapal
>> On 28-Jan-2016, at 5:47 pm, Daniel Mezentsev <da...@soleks.com> wrote:
>>
>> Hi Remi,
>>
>> I just upgraded 4.6.2->4.7.1 The same issue, unable to start 2 VRs (out
>> of
>> 8 total). VR actually is started, running for 5-7 minutes, then shuting
>> down. One thing that i noticed in the log:
>>
>> arping -c 1 -I eth0 -A -U -s 10.1.12.1 None
>>
>> What is "None" here ?
>>
>> Please let me know what information from the log can i provide you to
>> help
>> with troubleshooting. I noticed that there are a lot of the same issues
>> happened after upgrade to 4.6, seems like it's getting critical.
>>
>>> No, just the same template so it's just a matter of upgrading package.
>>> Will ping you when the release is ready.
>>>
>>> Regards, Remi
>>>
>>> Sent from my iPhone
>>>
>>>> On 25 Jan 2016, at 21:41, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>
>>>> Hi Remi,
>>>>
>>>> Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be
>>
>> with
>>>> new templates for system VMs ?
>>>>
>>>>> Hi Daniel,
>>>>>
>>>>> Is upgrading to 4.7.1 (once released tomorrow) an option? It has many
>>>>> improvements over 4.6.x and I'm quite sure it fixes the problem you
>>>>> experience now.
>>>>>
>>>>> Regards, Remi
>>>>>
>>>>> Sent from my iPhone
>>>>>
>>>>>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>>
>>>>>> in my configuration VR is acting as DHCP/DNS server, so it's not
>>>>>> passing
>>>>>> any traffic, so i can exclude public IP addresses. Definetely there
>>>>>> is
>>>>>> one
>>>>>> of the VR script is acting badly.
>>>>>>
>>>>>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep
20
>>>>
>>>> vms
>>>>>>> associated with the network), the network (virtual router) restart
>>>>>>> with
>>>>>>> clean up successfully (around in 3 min).
>>>>>>> I thinks that is a timeout problem (or VR scripts performance)...
>>>>>>> but
>>>>>>> which timeout parameter?
>>>>>>>
>>>>>>>> On 24/01/2016 09:43, Milamber wrote:
>>>>>>>> Please note, my installation type is Advanced network without
>>>>>>>> security
>>>>>>>> groups (vlan isolation).
>>>>>>>>
>>>>>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> We have seen this issue sometimes in the VRs from 4.6 and on.
>>>>>>>>> There
>>>>>>>>> have been several improvements in the code in 4.7.
>>>>>>>>>
>>>>>>>>> Also, setting router.aggregation.command.each.timeout global
>>
>> setting
>>>>>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>>>>>
>>>>>>>>> @Milamber can you test this setting with 4.7.1RC please? I
haven't
>>>>>>>>> seen this issue in my test and production systems.
>>>>>>>>>
>>>>>>>>> Thanks, Remi
>>>>>>>>>
>>>>>>>>> Sent from my iPhone
>>>>>>>>>
>>>>>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>>>>>>>
>>>>>>>>>> Hello,
>>>>>>>>>>
>>>>>>>>>> I've have a similiar issue without solution (but not with an
>>>>>>>>>> upgrade
>>>>>>>>>> from 4.5), please see
>>>>>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>>>>>
>>>>>>>>>> Milamber
>>>>>>>>>>
>>>>>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>>>>>> Hi All,
>>>>>>>>>>>
>>>>>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 ->
4.6.2.
>>>>>>>>>>> Environment has 8 VR, 6 were upgraded and restarted
>>>>>>>>>>> successfully, 2
>>>>>>>>>>> of them
>>>>>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>>>>>> restarted
>>>>>>>>>>> network with clean-up - no luck.
>>>>>>>>>>> VR actually is starting, i can ssh to it, but it's shuting down
>>
>> in
>>>>>>>>>>> approx 5
>>>>>>>>>>> minutes. I can extend it runing
>>>>>>>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>>>>>>>
>>>>>>>>>>> I can bing some VMs within the same subnet, so it's not
>>>>
>>>> VLAN/network
>>>>>>>>>>> issue.
>>>>>>>>>>>
>>>>>>>>>>> Completely ran out of ideas.
>>>>>>>>>>> Should mention network offering is Isolated network without
NAT.
>>>>>>>>>>>
>>>>>>>>>>> Any help is more then welcome. I can provide any related log,
>>>>>>>>>>> but i
>>>>>>>>>>> need
>>>>>>>>>>> some heads-up what i should look for.
>>>>>>>>>>> Daniel Mezentsev, founder
>>>>>>>>>>> (+1) 604 313 8592.
>>>>>>>>>>> Soleks Data Group.
>>>>>>>>>>> Shaping the clouds.
>>>>>>
>>>>>> Daniel Mezentsev, founder
>>>>>> (+1) 604 313 8592.
>>>>>> Soleks Data Group.Shaping the clouds.
>>>>
>>>> Daniel Mezentsev, founder
>>>> (+1) 604 313 8592.
>>>> Soleks Data Group.Shaping the clouds.
>>
>> Daniel Mezentsev, founder
>> (+1) 604 313 8592.
>> Soleks Data Group.Shaping the clouds.
>
>
Daniel Mezentsev, founder
(+1) 604 313 8592.
Soleks Data Group.
Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Jayapal Reddy Uradi <ja...@citrix.com>.
Hi Daniel,
Please share the MS logs when the VR is going down.
I want to check, Is MS bringing down the VR ? or VR is getting rebooted itself.
Thanks,
Jaqyapal
> On 28-Jan-2016, at 5:47 pm, Daniel Mezentsev <da...@soleks.com> wrote:
>
> Hi Remi,
>
> I just upgraded 4.6.2->4.7.1 The same issue, unable to start 2 VRs (out of
> 8 total). VR actually is started, running for 5-7 minutes, then shuting
> down. One thing that i noticed in the log:
>
> arping -c 1 -I eth0 -A -U -s 10.1.12.1 None
>
> What is "None" here ?
>
> Please let me know what information from the log can i provide you to help
> with troubleshooting. I noticed that there are a lot of the same issues
> happened after upgrade to 4.6, seems like it's getting critical.
>
>> No, just the same template so it's just a matter of upgrading package.
>> Will ping you when the release is ready.
>>
>> Regards, Remi
>>
>> Sent from my iPhone
>>
>>> On 25 Jan 2016, at 21:41, Daniel Mezentsev <da...@soleks.com> wrote:
>>>
>>> Hi Remi,
>>>
>>> Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be
> with
>>> new templates for system VMs ?
>>>
>>>> Hi Daniel,
>>>>
>>>> Is upgrading to 4.7.1 (once released tomorrow) an option? It has many
>>>> improvements over 4.6.x and I'm quite sure it fixes the problem you
>>>> experience now.
>>>>
>>>> Regards, Remi
>>>>
>>>> Sent from my iPhone
>>>>
>>>>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>>
>>>>> in my configuration VR is acting as DHCP/DNS server, so it's not
>>>>> passing
>>>>> any traffic, so i can exclude public IP addresses. Definetely there is
>>>>> one
>>>>> of the VR script is acting badly.
>>>>>
>>>>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep 20
>>>
>>> vms
>>>>>> associated with the network), the network (virtual router) restart
>>>>>> with
>>>>>> clean up successfully (around in 3 min).
>>>>>> I thinks that is a timeout problem (or VR scripts performance)... but
>>>>>> which timeout parameter?
>>>>>>
>>>>>>> On 24/01/2016 09:43, Milamber wrote:
>>>>>>> Please note, my installation type is Advanced network without
>>>>>>> security
>>>>>>> groups (vlan isolation).
>>>>>>>
>>>>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> We have seen this issue sometimes in the VRs from 4.6 and on. There
>>>>>>>> have been several improvements in the code in 4.7.
>>>>>>>>
>>>>>>>> Also, setting router.aggregation.command.each.timeout global
> setting
>>>>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>>>>
>>>>>>>> @Milamber can you test this setting with 4.7.1RC please? I haven't
>>>>>>>> seen this issue in my test and production systems.
>>>>>>>>
>>>>>>>> Thanks, Remi
>>>>>>>>
>>>>>>>> Sent from my iPhone
>>>>>>>>
>>>>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>>>>>>
>>>>>>>>> Hello,
>>>>>>>>>
>>>>>>>>> I've have a similiar issue without solution (but not with an
>>>>>>>>> upgrade
>>>>>>>>> from 4.5), please see
>>>>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>>>>
>>>>>>>>> Milamber
>>>>>>>>>
>>>>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>>>>> Hi All,
>>>>>>>>>>
>>>>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>>>>>>>>> Environment has 8 VR, 6 were upgraded and restarted
>>>>>>>>>> successfully, 2
>>>>>>>>>> of them
>>>>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>>>>> restarted
>>>>>>>>>> network with clean-up - no luck.
>>>>>>>>>> VR actually is starting, i can ssh to it, but it's shuting down
> in
>>>>>>>>>> approx 5
>>>>>>>>>> minutes. I can extend it runing
>>>>>>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>>>>>>
>>>>>>>>>> I can bing some VMs within the same subnet, so it's not
>>>
>>> VLAN/network
>>>>>>>>>> issue.
>>>>>>>>>>
>>>>>>>>>> Completely ran out of ideas.
>>>>>>>>>> Should mention network offering is Isolated network without NAT.
>>>>>>>>>>
>>>>>>>>>> Any help is more then welcome. I can provide any related log,
>>>>>>>>>> but i
>>>>>>>>>> need
>>>>>>>>>> some heads-up what i should look for.
>>>>>>>>>> Daniel Mezentsev, founder
>>>>>>>>>> (+1) 604 313 8592.
>>>>>>>>>> Soleks Data Group.
>>>>>>>>>> Shaping the clouds.
>>>>>
>>>>> Daniel Mezentsev, founder
>>>>> (+1) 604 313 8592.
>>>>> Soleks Data Group.Shaping the clouds.
>>>
>>> Daniel Mezentsev, founder
>>> (+1) 604 313 8592.
>>> Soleks Data Group.Shaping the clouds.
>>
>>
> Daniel Mezentsev, founder
> (+1) 604 313 8592.
> Soleks Data Group.
> Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Daniel Mezentsev <da...@soleks.com>.
Hi Remi,
I just upgraded 4.6.2->4.7.1 The same issue, unable to start 2 VRs (out of
8 total). VR actually is started, running for 5-7 minutes, then shuting
down. One thing that i noticed in the log:
arping -c 1 -I eth0 -A -U -s 10.1.12.1 None
What is "None" here ?
Please let me know what information from the log can i provide you to help
with troubleshooting. I noticed that there are a lot of the same issues
happened after upgrade to 4.6, seems like it's getting critical.
> No, just the same template so it's just a matter of upgrading package.
> Will ping you when the release is ready.
>
> Regards, Remi
>
> Sent from my iPhone
>
>> On 25 Jan 2016, at 21:41, Daniel Mezentsev <da...@soleks.com> wrote:
>>
>> Hi Remi,
>>
>> Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be
with
>> new templates for system VMs ?
>>
>>> Hi Daniel,
>>>
>>> Is upgrading to 4.7.1 (once released tomorrow) an option? It has many
>>> improvements over 4.6.x and I'm quite sure it fixes the problem you
>>> experience now.
>>>
>>> Regards, Remi
>>>
>>> Sent from my iPhone
>>>
>>>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>>>
>>>> in my configuration VR is acting as DHCP/DNS server, so it's not
>>>> passing
>>>> any traffic, so i can exclude public IP addresses. Definetely there is
>>>> one
>>>> of the VR script is acting badly.
>>>>
>>>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep 20
>>
>> vms
>>>>> associated with the network), the network (virtual router) restart
>>>>> with
>>>>> clean up successfully (around in 3 min).
>>>>> I thinks that is a timeout problem (or VR scripts performance)... but
>>>>> which timeout parameter?
>>>>>
>>>>>> On 24/01/2016 09:43, Milamber wrote:
>>>>>> Please note, my installation type is Advanced network without
>>>>>> security
>>>>>> groups (vlan isolation).
>>>>>>
>>>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>>>> Hi,
>>>>>>>
>>>>>>> We have seen this issue sometimes in the VRs from 4.6 and on. There
>>>>>>> have been several improvements in the code in 4.7.
>>>>>>>
>>>>>>> Also, setting router.aggregation.command.each.timeout global
setting
>>>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>>>
>>>>>>> @Milamber can you test this setting with 4.7.1RC please? I haven't
>>>>>>> seen this issue in my test and production systems.
>>>>>>>
>>>>>>> Thanks, Remi
>>>>>>>
>>>>>>> Sent from my iPhone
>>>>>>>
>>>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>>>>>
>>>>>>>> Hello,
>>>>>>>>
>>>>>>>> I've have a similiar issue without solution (but not with an
>>>>>>>> upgrade
>>>>>>>> from 4.5), please see
>>>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>>>
>>>>>>>> Milamber
>>>>>>>>
>>>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>>>> Hi All,
>>>>>>>>>
>>>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>>>>>>>> Environment has 8 VR, 6 were upgraded and restarted
>>>>>>>>> successfully, 2
>>>>>>>>> of them
>>>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>>>> restarted
>>>>>>>>> network with clean-up - no luck.
>>>>>>>>> VR actually is starting, i can ssh to it, but it's shuting down
in
>>>>>>>>> approx 5
>>>>>>>>> minutes. I can extend it runing
>>>>>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>>>>>
>>>>>>>>> I can bing some VMs within the same subnet, so it's not
>>
>> VLAN/network
>>>>>>>>> issue.
>>>>>>>>>
>>>>>>>>> Completely ran out of ideas.
>>>>>>>>> Should mention network offering is Isolated network without NAT.
>>>>>>>>>
>>>>>>>>> Any help is more then welcome. I can provide any related log,
>>>>>>>>> but i
>>>>>>>>> need
>>>>>>>>> some heads-up what i should look for.
>>>>>>>>> Daniel Mezentsev, founder
>>>>>>>>> (+1) 604 313 8592.
>>>>>>>>> Soleks Data Group.
>>>>>>>>> Shaping the clouds.
>>>>
>>>> Daniel Mezentsev, founder
>>>> (+1) 604 313 8592.
>>>> Soleks Data Group.Shaping the clouds.
>>
>> Daniel Mezentsev, founder
>> (+1) 604 313 8592.
>> Soleks Data Group.Shaping the clouds.
>
>
Daniel Mezentsev, founder
(+1) 604 313 8592.
Soleks Data Group.
Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Remi Bergsma <RB...@schubergphilis.com>.
No, just the same template so it's just a matter of upgrading package. Will ping you when the release is ready.
Regards, Remi
Sent from my iPhone
> On 25 Jan 2016, at 21:41, Daniel Mezentsev <da...@soleks.com> wrote:
>
> Hi Remi,
>
> Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be with
> new templates for system VMs ?
>
>> Hi Daniel,
>>
>> Is upgrading to 4.7.1 (once released tomorrow) an option? It has many
>> improvements over 4.6.x and I'm quite sure it fixes the problem you
>> experience now.
>>
>> Regards, Remi
>>
>> Sent from my iPhone
>>
>>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>>
>>> in my configuration VR is acting as DHCP/DNS server, so it's not passing
>>> any traffic, so i can exclude public IP addresses. Definetely there is
>>> one
>>> of the VR script is acting badly.
>>>
>>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep 20
> vms
>>>> associated with the network), the network (virtual router) restart with
>>>> clean up successfully (around in 3 min).
>>>> I thinks that is a timeout problem (or VR scripts performance)... but
>>>> which timeout parameter?
>>>>
>>>>> On 24/01/2016 09:43, Milamber wrote:
>>>>> Please note, my installation type is Advanced network without security
>>>>> groups (vlan isolation).
>>>>>
>>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>>> Hi,
>>>>>>
>>>>>> We have seen this issue sometimes in the VRs from 4.6 and on. There
>>>>>> have been several improvements in the code in 4.7.
>>>>>>
>>>>>> Also, setting router.aggregation.command.each.timeout global setting
>>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>>
>>>>>> @Milamber can you test this setting with 4.7.1RC please? I haven't
>>>>>> seen this issue in my test and production systems.
>>>>>>
>>>>>> Thanks, Remi
>>>>>>
>>>>>> Sent from my iPhone
>>>>>>
>>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>>>>
>>>>>>> Hello,
>>>>>>>
>>>>>>> I've have a similiar issue without solution (but not with an upgrade
>>>>>>> from 4.5), please see
>>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>>
>>>>>>> Milamber
>>>>>>>
>>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>>> Hi All,
>>>>>>>>
>>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>>>>>>> Environment has 8 VR, 6 were upgraded and restarted successfully, 2
>>>>>>>> of them
>>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>>> restarted
>>>>>>>> network with clean-up - no luck.
>>>>>>>> VR actually is starting, i can ssh to it, but it's shuting down in
>>>>>>>> approx 5
>>>>>>>> minutes. I can extend it runing
>>>>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>>>>
>>>>>>>> I can bing some VMs within the same subnet, so it's not
> VLAN/network
>>>>>>>> issue.
>>>>>>>>
>>>>>>>> Completely ran out of ideas.
>>>>>>>> Should mention network offering is Isolated network without NAT.
>>>>>>>>
>>>>>>>> Any help is more then welcome. I can provide any related log, but i
>>>>>>>> need
>>>>>>>> some heads-up what i should look for.
>>>>>>>> Daniel Mezentsev, founder
>>>>>>>> (+1) 604 313 8592.
>>>>>>>> Soleks Data Group.
>>>>>>>> Shaping the clouds.
>>>
>>> Daniel Mezentsev, founder
>>> (+1) 604 313 8592.
>>> Soleks Data Group.Shaping the clouds.
> Daniel Mezentsev, founder
> (+1) 604 313 8592.
> Soleks Data Group.
> Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Daniel Mezentsev <da...@soleks.com>.
Hi Remi,
Absolutely. I don't see any issue to do upgrade to 4.7.1. Will it be with
new templates for system VMs ?
> Hi Daniel,
>
> Is upgrading to 4.7.1 (once released tomorrow) an option? It has many
> improvements over 4.6.x and I'm quite sure it fixes the problem you
> experience now.
>
> Regards, Remi
>
> Sent from my iPhone
>
>> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>>
>> in my configuration VR is acting as DHCP/DNS server, so it's not passing
>> any traffic, so i can exclude public IP addresses. Definetely there is
>> one
>> of the VR script is acting badly.
>>
>>> If I disassociated 10 public IPs and keep 10 public IPs (but keep 20
vms
>>> associated with the network), the network (virtual router) restart with
>>> clean up successfully (around in 3 min).
>>> I thinks that is a timeout problem (or VR scripts performance)... but
>>> which timeout parameter?
>>>
>>>> On 24/01/2016 09:43, Milamber wrote:
>>>> Please note, my installation type is Advanced network without security
>>>> groups (vlan isolation).
>>>>
>>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>>> Hi,
>>>>>
>>>>> We have seen this issue sometimes in the VRs from 4.6 and on. There
>>>>> have been several improvements in the code in 4.7.
>>>>>
>>>>> Also, setting router.aggregation.command.each.timeout global setting
>>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>>
>>>>> @Milamber can you test this setting with 4.7.1RC please? I haven't
>>>>> seen this issue in my test and production systems.
>>>>>
>>>>> Thanks, Remi
>>>>>
>>>>> Sent from my iPhone
>>>>>
>>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>>>
>>>>>> Hello,
>>>>>>
>>>>>> I've have a similiar issue without solution (but not with an upgrade
>>>>>> from 4.5), please see
>>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>>
>>>>>> Milamber
>>>>>>
>>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>>> Hi All,
>>>>>>>
>>>>>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>>>>>> Environment has 8 VR, 6 were upgraded and restarted successfully, 2
>>>>>>> of them
>>>>>>> stuck. I removed them - the same result, i can't boot them,
>>>>>>> restarted
>>>>>>> network with clean-up - no luck.
>>>>>>> VR actually is starting, i can ssh to it, but it's shuting down in
>>>>>>> approx 5
>>>>>>> minutes. I can extend it runing
>>>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>>>
>>>>>>> I can bing some VMs within the same subnet, so it's not
VLAN/network
>>>>>>> issue.
>>>>>>>
>>>>>>> Completely ran out of ideas.
>>>>>>> Should mention network offering is Isolated network without NAT.
>>>>>>>
>>>>>>> Any help is more then welcome. I can provide any related log, but i
>>>>>>> need
>>>>>>> some heads-up what i should look for.
>>>>>>> Daniel Mezentsev, founder
>>>>>>> (+1) 604 313 8592.
>>>>>>> Soleks Data Group.
>>>>>>> Shaping the clouds.
>>
>> Daniel Mezentsev, founder
>> (+1) 604 313 8592.
>> Soleks Data Group.Shaping the clouds.
>
>
Daniel Mezentsev, founder
(+1) 604 313 8592.
Soleks Data Group.
Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Remi Bergsma <RB...@schubergphilis.com>.
Hi Daniel,
Is upgrading to 4.7.1 (once released tomorrow) an option? It has many improvements over 4.6.x and I'm quite sure it fixes the problem you experience now.
Regards, Remi
Sent from my iPhone
> On 25 Jan 2016, at 16:29, Daniel Mezentsev <da...@soleks.com> wrote:
>
> in my configuration VR is acting as DHCP/DNS server, so it's not passing
> any traffic, so i can exclude public IP addresses. Definetely there is one
> of the VR script is acting badly.
>
>
>> If I disassociated 10 public IPs and keep 10 public IPs (but keep 20 vms
>> associated with the network), the network (virtual router) restart with
>> clean up successfully (around in 3 min).
>> I thinks that is a timeout problem (or VR scripts performance)... but
>> which timeout parameter?
>>
>>> On 24/01/2016 09:43, Milamber wrote:
>>> Please note, my installation type is Advanced network without security
>>> groups (vlan isolation).
>>>
>>>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>>> Hi,
>>>>
>>>> We have seen this issue sometimes in the VRs from 4.6 and on. There
>>>> have been several improvements in the code in 4.7.
>>>>
>>>> Also, setting router.aggregation.command.each.timeout global setting
>>>> to 15 or 20 also may help (restart mgt server after change).
>>>>
>>>> @Milamber can you test this setting with 4.7.1RC please? I haven't
>>>> seen this issue in my test and production systems.
>>>>
>>>> Thanks, Remi
>>>>
>>>> Sent from my iPhone
>>>>
>>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>>
>>>>> Hello,
>>>>>
>>>>> I've have a similiar issue without solution (but not with an upgrade
>>>>> from 4.5), please see
>>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>>
>>>>> Milamber
>>>>>
>>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>>> Hi All,
>>>>>>
>>>>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>>>>> Environment has 8 VR, 6 were upgraded and restarted successfully, 2
>>>>>> of them
>>>>>> stuck. I removed them - the same result, i can't boot them, restarted
>>>>>> network with clean-up - no luck.
>>>>>> VR actually is starting, i can ssh to it, but it's shuting down in
>>>>>> approx 5
>>>>>> minutes. I can extend it runing
>>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>>
>>>>>> I can bing some VMs within the same subnet, so it's not VLAN/network
>>>>>> issue.
>>>>>>
>>>>>> Completely ran out of ideas.
>>>>>> Should mention network offering is Isolated network without NAT.
>>>>>>
>>>>>> Any help is more then welcome. I can provide any related log, but i
>>>>>> need
>>>>>> some heads-up what i should look for.
>>>>>> Daniel Mezentsev, founder
>>>>>> (+1) 604 313 8592.
>>>>>> Soleks Data Group.
>>>>>> Shaping the clouds.
> Daniel Mezentsev, founder
> (+1) 604 313 8592.
> Soleks Data Group.
> Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Daniel Mezentsev <da...@soleks.com>.
in my configuration VR is acting as DHCP/DNS server, so it's not passing
any traffic, so i can exclude public IP addresses. Definetely there is one
of the VR script is acting badly.
> If I disassociated 10 public IPs and keep 10 public IPs (but keep 20 vms
> associated with the network), the network (virtual router) restart with
> clean up successfully (around in 3 min).
> I thinks that is a timeout problem (or VR scripts performance)... but
> which timeout parameter?
>
> On 24/01/2016 09:43, Milamber wrote:
>> Please note, my installation type is Advanced network without security
>> groups (vlan isolation).
>>
>> On 24/01/2016 06:57, Remi Bergsma wrote:
>>> Hi,
>>>
>>> We have seen this issue sometimes in the VRs from 4.6 and on. There
>>> have been several improvements in the code in 4.7.
>>>
>>> Also, setting router.aggregation.command.each.timeout global setting
>>> to 15 or 20 also may help (restart mgt server after change).
>>>
>>> @Milamber can you test this setting with 4.7.1RC please? I haven't
>>> seen this issue in my test and production systems.
>>>
>>> Thanks, Remi
>>>
>>> Sent from my iPhone
>>>
>>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>>
>>>> Hello,
>>>>
>>>> I've have a similiar issue without solution (but not with an upgrade
>>>> from 4.5), please see
>>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>>
>>>> Milamber
>>>>
>>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>>> Hi All,
>>>>>
>>>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>>>> Environment has 8 VR, 6 were upgraded and restarted successfully, 2
>>>>> of them
>>>>> stuck. I removed them - the same result, i can't boot them, restarted
>>>>> network with clean-up - no luck.
>>>>> VR actually is starting, i can ssh to it, but it's shuting down in
>>>>> approx 5
>>>>> minutes. I can extend it runing
>>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>>
>>>>> I can bing some VMs within the same subnet, so it's not VLAN/network
>>>>> issue.
>>>>>
>>>>> Completely ran out of ideas.
>>>>> Should mention network offering is Isolated network without NAT.
>>>>>
>>>>> Any help is more then welcome. I can provide any related log, but i
>>>>> need
>>>>> some heads-up what i should look for.
>>>>> Daniel Mezentsev, founder
>>>>> (+1) 604 313 8592.
>>>>> Soleks Data Group.
>>>>> Shaping the clouds.
>
>
Daniel Mezentsev, founder
(+1) 604 313 8592.
Soleks Data Group.
Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Milamber <mi...@apache.org>.
If I disassociated 10 public IPs and keep 10 public IPs (but keep 20 vms
associated with the network), the network (virtual router) restart with
clean up successfully (around in 3 min).
I thinks that is a timeout problem (or VR scripts performance)... but
which timeout parameter?
On 24/01/2016 09:43, Milamber wrote:
>
> Please note, my installation type is Advanced network without security
> groups (vlan isolation).
>
> On 24/01/2016 06:57, Remi Bergsma wrote:
>> Hi,
>>
>> We have seen this issue sometimes in the VRs from 4.6 and on. There
>> have been several improvements in the code in 4.7.
>>
>> Also, setting router.aggregation.command.each.timeout global setting
>> to 15 or 20 also may help (restart mgt server after change).
>>
>> @Milamber can you test this setting with 4.7.1RC please? I haven't
>> seen this issue in my test and production systems.
>>
>> Thanks, Remi
>>
>> Sent from my iPhone
>>
>>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>>
>>>
>>> Hello,
>>>
>>> I've have a similiar issue without solution (but not with an upgrade
>>> from 4.5), please see
>>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>>
>>> Milamber
>>>
>>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>>> Hi All,
>>>>
>>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>>> Environment has 8 VR, 6 were upgraded and restarted successfully, 2
>>>> of them
>>>> stuck. I removed them - the same result, i can't boot them, restarted
>>>> network with clean-up - no luck.
>>>> VR actually is starting, i can ssh to it, but it's shuting down in
>>>> approx 5
>>>> minutes. I can extend it runing
>>>> "init 3" command, but cloudstack is not detecting router state.
>>>>
>>>> I can bing some VMs within the same subnet, so it's not
>>>> VLAN/network issue.
>>>>
>>>> Completely ran out of ideas.
>>>> Should mention network offering is Isolated network without NAT.
>>>>
>>>> Any help is more then welcome. I can provide any related log, but i
>>>> need
>>>> some heads-up what i should look for.
>>>> Daniel Mezentsev, founder
>>>> (+1) 604 313 8592.
>>>> Soleks Data Group.
>>>> Shaping the clouds.
>
>
Re: Issue with VR after upgrade to 4.6.2
Posted by Milamber <mi...@apache.org>.
Please note, my installation type is Advanced network without security
groups (vlan isolation).
On 24/01/2016 06:57, Remi Bergsma wrote:
> Hi,
>
> We have seen this issue sometimes in the VRs from 4.6 and on. There have been several improvements in the code in 4.7.
>
> Also, setting router.aggregation.command.each.timeout global setting to 15 or 20 also may help (restart mgt server after change).
>
> @Milamber can you test this setting with 4.7.1RC please? I haven't seen this issue in my test and production systems.
>
> Thanks, Remi
>
> Sent from my iPhone
>
>> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>>
>>
>> Hello,
>>
>> I've have a similiar issue without solution (but not with an upgrade from 4.5), please see
>> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>>
>> Milamber
>>
>>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>>> Hi All,
>>>
>>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>>> Environment has 8 VR, 6 were upgraded and restarted successfully, 2 of them
>>> stuck. I removed them - the same result, i can't boot them, restarted
>>> network with clean-up - no luck.
>>> VR actually is starting, i can ssh to it, but it's shuting down in approx 5
>>> minutes. I can extend it runing
>>> "init 3" command, but cloudstack is not detecting router state.
>>>
>>> I can bing some VMs within the same subnet, so it's not VLAN/network issue.
>>>
>>> Completely ran out of ideas.
>>> Should mention network offering is Isolated network without NAT.
>>>
>>> Any help is more then welcome. I can provide any related log, but i need
>>> some heads-up what i should look for.
>>> Daniel Mezentsev, founder
>>> (+1) 604 313 8592.
>>> Soleks Data Group.
>>> Shaping the clouds.
Re: Issue with VR after upgrade to 4.6.2
Posted by Remi Bergsma <RB...@schubergphilis.com>.
Hi,
We have seen this issue sometimes in the VRs from 4.6 and on. There have been several improvements in the code in 4.7.
Also, setting router.aggregation.command.each.timeout global setting to 15 or 20 also may help (restart mgt server after change).
@Milamber can you test this setting with 4.7.1RC please? I haven't seen this issue in my test and production systems.
Thanks, Remi
Sent from my iPhone
> On 24 Jan 2016, at 00:49, Milamber <mi...@apache.org> wrote:
>
>
> Hello,
>
> I've have a similiar issue without solution (but not with an upgrade from 4.5), please see
> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>
> Milamber
>
>> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>> Hi All,
>>
>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>> Environment has 8 VR, 6 were upgraded and restarted successfully, 2 of them
>> stuck. I removed them - the same result, i can't boot them, restarted
>> network with clean-up - no luck.
>> VR actually is starting, i can ssh to it, but it's shuting down in approx 5
>> minutes. I can extend it runing
>> "init 3" command, but cloudstack is not detecting router state.
>>
>> I can bing some VMs within the same subnet, so it's not VLAN/network issue.
>>
>> Completely ran out of ideas.
>> Should mention network offering is Isolated network without NAT.
>>
>> Any help is more then welcome. I can provide any related log, but i need
>> some heads-up what i should look for.
>> Daniel Mezentsev, founder
>> (+1) 604 313 8592.
>> Soleks Data Group.
>> Shaping the clouds.
>
Re: Issue with VR after upgrade to 4.6.2
Posted by Daniel Mezentsev <da...@soleks.com>.
Hi,
Seems like you have completely different environment, mine is XenServer +
SAN (FC) storage + centos as VMs, but with the same simptoms. Definetely
need some input from dev guys. I did research through internet, there are
several issues with the same description, but no solution. I'd mark is as
critical, as it significantly affect environment.
> Hello,
>
> I've have a similiar issue without solution (but not with an upgrade
> from 4.5), please see
> https://issues.apache.org/jira/browse/CLOUDSTACK-9255
>
> Milamber
>
> On 24/01/2016 03:32, Daniel Mezentsev wrote:
>> Hi All,
>>
>> I've got some issue after i did cloudstack upgrade 4.5 -> 4.6.2.
>> Environment has 8 VR, 6 were upgraded and restarted successfully, 2 of
>> them
>> stuck. I removed them - the same result, i can't boot them, restarted
>> network with clean-up - no luck.
>> VR actually is starting, i can ssh to it, but it's shuting down in
>> approx 5
>> minutes. I can extend it runing
>> "init 3" command, but cloudstack is not detecting router state.
>>
>> I can bing some VMs within the same subnet, so it's not VLAN/network
>> issue.
>>
>> Completely ran out of ideas.
>> Should mention network offering is Isolated network without NAT.
>>
>> Any help is more then welcome. I can provide any related log, but i need
>> some heads-up what i should look for.
>> Daniel Mezentsev, founder
>> (+1) 604 313 8592.
>> Soleks Data Group.
>> Shaping the clouds.
>
>
Daniel Mezentsev, founder
(+1) 604 313 8592.
Soleks Data Group.
Shaping the clouds.