You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@openwhisk.apache.org by GitBox <gi...@apache.org> on 2019/05/16 06:04:24 UTC
[GitHub] [incubator-openwhisk] axiqia opened a new issue #4483: controller
registered Redundant invokers
axiqia opened a new issue #4483: controller registered Redundant invokers
URL: https://github.com/apache/incubator-openwhisk/issues/4483
<!--
We use the issue tracker for bugs and feature requests. For general questions and discussion please use http://slack.openwhisk.org/ or https://openwhisk.apache.org/contact.html instead.
Do NOT share passwords, credentials or other confidential information.
Before creating a new issue, please check if there is one already open that
fits the defect you are reporting.
If you open an issue and realize later it is a duplicate of a pre-existing
open issue, please close yours and add a comment to the other.
Issues can be created for either defects or enhancement requests. If you are a committer than please add the labels "bug" or "feature". If you are not a committer please make clear in the comments which one it is, so that committers can add these labels later.
If you are reporting a defect, please edit the issue description to include the
information shown below.
If you are reporting an enhancement request, please include information on what you are trying to achieve and why that enhancement would help you.
For more information about reporting issues, see
https://github.com/apache/incubator-openwhisk/blob/master/CONTRIBUTING.md#raising-issues
Use the commands below to provide key information from your environment:
You do not have to include this information if this is a feature request.
-->
## Environment details:
* local deployment, native ubuntu:16.04
* version of docker: 17.03.0-ce
## Provide the actual results and outputs:
Ansible inventory:
```
$ cat environments/local/hosts
; the first parameter in a host is the inventory_hostname
; used for local actions only
ansible ansible_connection=local
[edge]
172.17.0.1 ansible_host=172.17.0.1 ansible_connection=local
[controllers]
controller0 ansible_host=172.17.0.1 ansible_connection=local
;
[kafkas]
kafka0 ansible_host=172.17.0.1 ansible_connection=local
[zookeepers:children]
kafkas
[invokers]
invoker0 ansible_host=172.17.0.1 ansible_connection=local
; db group is only used if db.provider is CouchDB
[db]
172.17.0.1 ansible_host=172.17.0.1 ansible_connection=local
[redis]
172.17.0.1 ansible_host=172.17.0.1 ansible_connection=local
[apigateway]
172.17.0.1 ansible_host=172.17.0.1 ansible_connection=local
```
Deploy cmd:
```
ansible-playbook -i environments/local openwhisk.yml -e skip_pull_runtimes=True -e invoker_user_memory="4096m" -e limit_invocations_per_minute=99999 -e limit_invocations_concurrent=99999
```
Part of Controller logs:
```
[2019-05-16T05:41:41.996Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] registered a new invoker: invoker0
[2019-05-16T05:41:42.011Z] [INFO] [#tid_sid_invokerHealth] [InvokerActor] invoker0 is unhealthy [marker:loadbalancer_invokerState.unhealthy_counter:17425]
[2019-05-16T05:41:42.026Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posting topic 'invoker0' with activation id '35ac202c481b4eb9ac202c481bbeb957' [marker:controll#
[2019-05-16T05:41:42.034Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] invoker status changed to 0 -> Unhealthy
[2019-05-16T05:41:42.037Z] [INFO] [#tid_sid_loadbalancer] [ShardingContainerPoolBalancerState] loadbalancer invoker status updated. managedInvokers = 1 blackboxInvokers = 1
[2019-05-16T05:41:42.125Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posted to invoker0[0][0] [marker:controller_kafka_finish:17539:99]
[2019-05-16T05:41:49.415Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] received completion ack for health action on invoker0/0
[2019-05-16T05:41:49.416Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posting topic 'invoker0' with activation id '633e2a97acbe479abe2a97acbe479a4e' [marker:controll#
[2019-05-16T05:41:49.418Z] [INFO] [#tid_sid_invokerHealth] [InvokerActor] invoker0 is up
[2019-05-16T05:41:49.419Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] invoker status changed to 0 -> Healthy
[2019-05-16T05:41:49.419Z] [INFO] [#tid_sid_loadbalancer] [ShardingContainerPoolBalancerState] loadbalancer invoker status updated. managedInvokers = 1 blackboxInvokers = 1
[2019-05-16T05:41:49.422Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posted to invoker0[0][1] [marker:controller_kafka_finish:24835:5]
[2019-05-16T05:41:50.027Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] received completion ack for health action on invoker0/0
[2019-05-16T05:42:40.823Z] [INFO] [#tid_sid_invokerHealth] [InvokerActor] invoker0 is down [marker:loadbalancer_invokerState.down_counter:76236]
[2019-05-16T05:42:40.858Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] invoker status changed to 0 -> Offline
[2019-05-16T05:42:40.859Z] [INFO] [#tid_sid_loadbalancer] [ShardingContainerPoolBalancerState] loadbalancer invoker status updated. managedInvokers = 1 blackboxInvokers = 1
[2019-05-16T05:42:44.142Z] [INFO] [#tid_sid_invokerHealth] [InvokerActor] invoker0 is unhealthy [marker:loadbalancer_invokerState.unhealthy_counter:79555]
[2019-05-16T05:42:44.143Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posting topic 'invoker0' with activation id '5918fca3da944d7e98fca3da94ed7e8a' [marker:controll#
[2019-05-16T05:42:44.146Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] invoker status changed to 0 -> Unhealthy
[2019-05-16T05:42:44.147Z] [INFO] [#tid_sid_loadbalancer] [ShardingContainerPoolBalancerState] loadbalancer invoker status updated. managedInvokers = 1 blackboxInvokers = 1
[2019-05-16T05:42:44.149Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posted to invoker0[0][2] [marker:controller_kafka_finish:79563:6]
[2019-05-16T05:43:31.812Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] registered a new invoker: invoker3
[2019-05-16T05:43:31.832Z] [INFO] [#tid_sid_invokerHealth] [InvokerActor] invoker3 is unhealthy [marker:loadbalancer_invokerState.unhealthy_counter:127228]
[2019-05-16T05:43:31.832Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posting topic 'invoker3' with activation id 'bc6c300096584701ac30009658b7019f' [marker:controll#
[2019-05-16T05:43:31.832Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] invoker status changed to 0 -> Unhealthy, 1 -> Offline, 2 -> Offline, 3 -> Unhealthy
[2019-05-16T05:43:31.832Z] [INFO] [#tid_sid_loadbalancer] [ShardingContainerPoolBalancerState] loadbalancer invoker status updated. managedInvokers = 4 blackboxInvokers = 1
[2019-05-16T05:43:40.841Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] received completion ack for health action on invoker0/0
[2019-05-16T05:43:40.864Z] [INFO] [#tid_sid_invokerHealth] [InvokerActor] invoker0 is up
[2019-05-16T05:43:40.865Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posting topic 'invoker0' with activation id '3a19cc9bad4e4d3199cc9bad4efd3151' [marker:controll#
[2019-05-16T05:43:40.865Z] [INFO] [#tid_sid_loadbalancer] [ShardingContainerPoolBalancerState] loadbalancer invoker status updated. managedInvokers = 4 blackboxInvokers = 1
[2019-05-16T05:43:40.865Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] invoker status changed to 0 -> Healthy, 1 -> Offline, 2 -> Offline, 3 -> Unhealthy
[2019-05-16T05:43:40.865Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posted to invoker0[0][3] [marker:controller_kafka_finish:136262:6]
[2019-05-16T05:43:42.190Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] received completion ack for health action on invoker0/0
[2019-05-16T05:43:42.495Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] registered a new invoker: invoker1
[2019-05-16T05:43:42.496Z] [INFO] [#tid_sid_invokerHealth] [InvokerActor] invoker1 is unhealthy [marker:loadbalancer_invokerState.unhealthy_counter:137910]
[2019-05-16T05:43:42.497Z] [INFO] [#tid_sid_invokerHealth] [ShardingContainerPoolBalancer] posting topic 'invoker1' with activation id '93b5181c50904932b5181c509049328e' [marker:controll#
[2019-05-16T05:43:42.499Z] [INFO] [#tid_sid_invokerHealth] [InvokerPool] invoker status changed to 0 -> Healthy, 1 -> Unhealthy, 2 -> Offline, 3 -> Unhealthy
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services