You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@openwhisk.apache.org by GitBox <gi...@apache.org> on 2017/11/20 18:00:49 UTC
[GitHub] rabbah opened a new issue #2987: invokers losing connection to kafka
rabbah opened a new issue #2987: invokers losing connection to kafka
URL: https://github.com/apache/incubator-openwhisk/issues/2987
I'm observing connection failures which don't recover since picking up master.
```
[2017-11-20T17:51:09.343Z] [ERROR] [??] [CouchDbRestStore] [PUT] 'whisk_dockermachine_activations' internal error, failure: 'Object is missing required member 'rev'' [marker:database_saveDocumentBulk_error:96713:15]
[2017-11-20T17:51:09.354Z] [ERROR] [#tid_20] [CouchDbRestStore] [PUT] 'whisk_dockermachine_activations' internal error, failure: 'Object is missing required member 'rev'' [marker:database_saveDocument_error:15825:17]
[2017-11-20T17:51:09.356Z] [ERROR] [#tid_20] [InvokerReactive] failed to record activation
[2017-11-20T17:51:09.435Z] [INFO] [#sid_102] [DockerClientWithFileAccess] [marker:invoker_docker.rm_finish:96807:94]
[2017-11-20T17:51:35.728Z] [ERROR] [??] [KafkaProducerConnector] sending message on topic 'health' failed: Expiring 1 record(s) for health-0: 30011 ms has passed since batch creation plus linger time
[2017-11-20T17:51:35.730Z] [ERROR] [??] [Invoker] failed to ping the controller: org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for health-0: 30011 ms has passed since batch creation plus linger time
[2017-11-20T17:51:36.926Z] [ERROR] [#tid_20] [KafkaProducerConnector] sending message on topic 'completed0' failed: Expiring 1 record(s) for completed0-0: 30011 ms has passed since batch creation plus linger time
... many more of these error
```
I think the couch error is unrelated but captured for completes.
@dgrove-oss FYI
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services