You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@couchdb.apache.org by "nickva (via GitHub)" <gi...@apache.org> on 2023/01/20 19:24:47 UTC
[GitHub] [couchdb] nickva opened a new issue, #4397: Flaky elixir test on faster macos CI workers
nickva opened a new issue, #4397:
URL: https://github.com/apache/couchdb/issues/4397
Our new fast macos test runner is exposing flaky tests like this one:
```
[2023-01-20T18:18:51.457Z] UsersDbTest [test/elixir/test/users_db_test.exs]
[2023-01-20T18:18:56.172Z] * test users password requirements [L#302]
* test users password requirements (4030.5ms) [L#302]
[2023-01-20T18:19:00.882Z] * test users db [L#104]
* test users db (5019.7ms) [L#104]
[2023-01-20T18:19:00.882Z]
[2023-01-20T18:19:00.882Z] 1) test users db (UsersDbTest)
[2023-01-20T18:19:00.882Z] test/elixir/test/users_db_test.exs:104
[2023-01-20T18:19:00.882Z] Assertion with != failed, both sides are exactly equal
[2023-01-20T18:19:00.882Z] code: assert ddoc.body["validate_doc_update"] != nil
[2023-01-20T18:19:00.882Z] left: nil
[2023-01-20T18:19:00.882Z] stacktrace:
[2023-01-20T18:19:00.882Z] test/elixir/test/users_db_test.exs:108: (test)
```
```
[2023-01-20T17:21:00.291Z] UsersDbTest [test/elixir/test/users_db_test.exs]
[2023-01-20T17:21:02.305Z] * test users password requirements [L#302]
* test users password requirements (2306.8ms) [L#302]
[2023-01-20T17:21:08.126Z] * test users db [L#104]
* test users db (5042.8ms) [L#104]
[2023-01-20T17:21:08.126Z]
[2023-01-20T17:21:08.126Z] 1) test users db (UsersDbTest)
[2023-01-20T17:21:08.126Z] test/elixir/test/users_db_test.exs:104
[2023-01-20T17:21:08.126Z] Assertion with != failed, both sides are exactly equal
[2023-01-20T17:21:08.126Z] code: assert ddoc.body["validate_doc_update"] != nil
[2023-01-20T17:21:08.126Z] left: nil
[2023-01-20T17:21:08.126Z] stacktrace:
[2023-01-20T17:21:08.126Z] test/elixir/test/users_db_test.exs:108: (test)
[2023-01-20T17:21:08.126Z]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] nickva commented on issue #4397: Flaky elixir and erlang test on faster CI workers
Posted by "nickva (via GitHub)" <gi...@apache.org>.
nickva commented on issue #4397:
URL: https://github.com/apache/couchdb/issues/4397#issuecomment-1454795820
I think that clears most of the common flaky tests we saw. Please re-open and add more flaky tests if you find any.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] nickva commented on issue #4397: Flaky elixir test on faster macos CI workers
Posted by "nickva (via GitHub)" <gi...@apache.org>.
nickva commented on issue #4397:
URL: https://github.com/apache/couchdb/issues/4397#issuecomment-1425027913
Another one is the prometheus test, also fails on macos
```
[2023-02-10T00:47:56.476Z] With dedicated port
[2023-02-10T00:47:57.767Z] couch_prometheus_e2e_tests:40: -e2e_test_/0-fun-4- (t_chttpd_port)...[0.089 s] ok
[2023-02-10T00:47:57.767Z] couch_prometheus_e2e_tests:41: -e2e_test_/0-fun-2- (t_prometheus_port)...[0.001 s] ok
[2023-02-10T00:48:02.481Z] couch_prometheus_e2e_tests:42: -e2e_test_/0-fun-0- (t_metric_updated)...*timed out*
[2023-02-10T00:48:02.481Z] in function gen:do_call/4 (gen.erl, line 256)
[2023-02-10T00:48:02.481Z] in call from gen_server:call/3 (gen_server.erl, line 381)
[2023-02-10T00:48:02.481Z] in call from ibrowse_http_client:send_req/7 (src/ibrowse_http_client.erl, line 114)
[2023-02-10T00:48:02.481Z] in call from ibrowse:do_send_req/7 (src/ibrowse.erl, line 500)
[2023-02-10T00:48:02.481Z] in call from ibrowse:try_routing_request/14 (src/ibrowse.erl, line 392)
[2023-02-10T00:48:02.481Z] in call from test_request:request/6 (src/test_request.erl, line 95)
[2023-02-10T00:48:02.482Z] in call from couch_prometheus_e2e_tests:get_stats/1 (test/eunit/couch_prometheus_e2e_tests.erl, line 135)
[2023-02-10T00:48:02.482Z] in call from couch_prometheus_e2e_tests:'-t_metric_updated/1-fun-1-'/2 (test/eunit/couch_prometheus_e2e_tests.erl, line 122)
[2023-02-10T00:48:02.482Z] undefined
[2023-02-10T00:48:02.482Z] [done in 5.116 s]
[2023-02-10T00:48:02.482Z] Without dedicated port
[2023-02-10T00:48:02.758Z] couch_prometheus_e2e_tests:65: -reject_test_/0-fun-0- (t_reject_prometheus_port)...[0.001 s] ok
[2023-02-10T00:48:02.758Z] [done in 0.004 s]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] nickva commented on issue #4397: Flaky elixir test on faster macos CI workers
Posted by "nickva (via GitHub)" <gi...@apache.org>.
nickva commented on issue #4397:
URL: https://github.com/apache/couchdb/issues/4397#issuecomment-1434764920
```
[2023-02-17T07:40:34.978Z] Test LRU limits
[2023-02-17T07:40:34.978Z] ets_lru_test:274: -test_limits/2-fun-1- (Max object count ok)...[0.038 s] ok
[2023-02-17T07:40:34.978Z] ets_lru_test:279: -test_limits/2-fun-3- (Max size ok)...[0.070 s] ok
[2023-02-17T07:40:34.978Z] ets_lru_test:285: -test_limits/2-fun-7- (Expire leaves new entries)...ok
[2023-02-17T07:40:34.978Z] ets_lru_test:292: -test_limits/2-fun-5- (Entry was expired)...*failed*
[2023-02-17T07:40:34.978Z] in function ets_lru_test:'-test_limits/2-fun-5-'/2 (test/ets_lru_test.erl, line 294)
[2023-02-17T07:40:34.978Z] in call from eunit_test:run_testfun/1 (eunit_test.erl, line 71)
[2023-02-17T07:40:34.978Z] in call from eunit_proc:run_test/1 (eunit_proc.erl, line 531)
[2023-02-17T07:40:34.978Z] in call from eunit_proc:with_timeout/3 (eunit_proc.erl, line 356)
[2023-02-17T07:40:34.978Z] in call from eunit_proc:handle_test/2 (eunit_proc.erl, line 514)
[2023-02-17T07:40:34.978Z] in call from eunit_proc:tests_inorder/3 (eunit_proc.erl, line 456)
[2023-02-17T07:40:34.978Z] in call from eunit_proc:with_timeout/3 (eunit_proc.erl, line 346)
[2023-02-17T07:40:34.978Z] in call from eunit_proc:run_group/2 (eunit_proc.erl, line 570)
[2023-02-17T07:40:34.978Z] **error:{assertEqual,[{module,ets_lru_test},
[2023-02-17T07:40:34.978Z] {line,294},
[2023-02-17T07:40:34.978Z] {expression,"ets_lru : lookup ( LRU , foo )"},
[2023-02-17T07:40:34.978Z] {expected,not_found},
[2023-02-17T07:40:34.978Z] {value,{ok,bar}}]}
[2023-02-17T07:40:34.978Z] output:<<"">>
[2023-02-17T07:40:34.978Z]
[2023-02-17T07:40:34.978Z] [done in 0.370 s]
[2023-02-17T07:40:34.978Z] Test match functions
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] nickva closed issue #4397: Flaky elixir and erlang test on faster CI workers
Posted by "nickva (via GitHub)" <gi...@apache.org>.
nickva closed issue #4397: Flaky elixir and erlang test on faster CI workers
URL: https://github.com/apache/couchdb/issues/4397
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org