You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@openwhisk.apache.org by GitBox <gi...@apache.org> on 2020/12/23 19:44:29 UTC

[GitHub] [openwhisk-wskdebug] alexkli opened a new issue #84: flaky agentmgr.test.js tests in Travis

alexkli opened a new issue #84:
URL: https://github.com/apache/openwhisk-wskdebug/issues/84


   The tests in agentmgr.test.js have become very flaky (Dec 2020 after not many changes and Travis job runs since the 1.3.0 release in July). Possibly due to newer [faster hardware in Travis](https://blog.travis-ci.com/2020-09-11-arm-on-aws) or docker related changes. It can resolve on a re-run, but it takes a few times.
   
   A similar flaky test was fixed in https://github.com/apache/openwhisk-wskdebug/pull/82.
   
   Example failed job: https://travis-ci.com/github/apache/openwhisk-wskdebug/jobs/464430797
   
   Test failures:
   
   ```
     1) agentmgr
          should use non-concurrent agent if openwhisk does not support concurrency:
        Error: Timeout of 30000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/travis/build/apache/openwhisk-wskdebug/test/agentmgr.test.js)
     
   
     2) agentmgr
          should handle if the agent was left around from a previous run:
        Error: (HTTP code 500) server error - driver failed programming external connectivity on endpoint wskdebug-myaction-1608750742209 (70bb0576af18dc960ee9ed18f704100d9baffe0f994f783f49330e4bd99a36c7): Bind for 0.0.0.0:46747 failed: port is already allocated 
         at /home/travis/build/apache/openwhisk-wskdebug/node_modules/docker-modem/lib/modem.js:296:17
         at getCause (node_modules/docker-modem/lib/modem.js:326:7)
         at Modem.buildPayload (node_modules/docker-modem/lib/modem.js:295:5)
         at IncomingMessage.<anonymous> (node_modules/docker-modem/lib/modem.js:270:14)
         at endReadableNT (_stream_readable.js:1145:12)
         at process._tickCallback (internal/process/next_tick.js:63:19)
   
     3) agentmgr
          should remove backup action if --cleanup is set:
        Error: Unexpected error while polling agent for activation.
         at AgentMgr.waitForActivations (src/agentmgr.js:65:181)
         at process._tickCallback (internal/process/next_tick.js:68:7)
   ```
   
   It seems the `should use non-concurrent agent if openwhisk does not support concurrency` fails to start or shutdown the docker container and times out waiting for that. This can then have detrimental effect on the subsequent tests that fail too, it seems.
   
   https://github.com/apache/openwhisk-wskdebug/blob/fa5b0b48fa7e3bad922b94ee80e5ff6f70800ded/test/agentmgr.test.js#L124-L145
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [openwhisk-wskdebug] alexkli commented on issue #84: flaky agentmgr.test.js tests in Travis

Posted by GitBox <gi...@apache.org>.
alexkli commented on issue #84:
URL: https://github.com/apache/openwhisk-wskdebug/issues/84#issuecomment-750492235


   With verbose logging it became clear the problem is that wskdebug inside the tests times out downloading the Runtime docker image `adobeapiplatform/adobe-action-nodejs-v10:3.0.21`.
   
   See https://travis-ci.com/github/apache/openwhisk-wskdebug/jobs/464466116
   
   This explains the flakyness as this depends on whether the image was cached in the Travis environment and on the bandwidth between Travis and docker hub.
   
   Fix: https://github.com/apache/openwhisk-wskdebug/pull/82/commits/ecdfaba7b697cf667837b72c2641c97952b44806
   
   Included in #82 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [openwhisk-wskdebug] alexkli closed issue #84: flaky agentmgr.test.js tests in Travis

Posted by GitBox <gi...@apache.org>.
alexkli closed issue #84:
URL: https://github.com/apache/openwhisk-wskdebug/issues/84


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org