You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@openwhisk.apache.org by "style95 (via GitHub)" <gi...@apache.org> on 2023/08/14 01:01:54 UTC
[GitHub] [openwhisk] style95 opened a new issue, #5433: Multi-runtime tests keep failing
style95 opened a new issue, #5433:
URL: https://github.com/apache/openwhisk/issues/5433
It's not clear when the regression is introduced, but the multi-runtime tests keep failing even with the recent 3 commits in the master branch.
<img width="1361" alt="image" src="https://github.com/apache/openwhisk/assets/3447251/b6b20949-8732-408d-a227-509c3e2b2a84">
## Additional information you deem important:
* I need to run the on-demand workflow to debug the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [openwhisk] style95 commented on issue #5433: Multi-runtime tests keep failing
Posted by "style95 (via GitHub)" <gi...@apache.org>.
style95 commented on issue #5433:
URL: https://github.com/apache/openwhisk/issues/5433#issuecomment-1677710833
I confirmed the current runc client in the invoker container cannot pause containers created by docker in the Github Actions runner and the container can be paused with the latest runc.
```
# /usr/bin/docker-runc pause faa7cdfef74d26fa9b79eda96932acdea85851ea3051795d5af5cd403264a9de
no such directory for freezer.state
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [openwhisk] style95 commented on issue #5433: Multi-runtime tests keep failing
Posted by "style95 (via GitHub)" <gi...@apache.org>.
style95 commented on issue #5433:
URL: https://github.com/apache/openwhisk/issues/5433#issuecomment-1679828314
closed by https://github.com/apache/openwhisk/pull/5437
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [openwhisk] style95 commented on issue #5433: Multi-runtime tests keep failing
Posted by "style95 (via GitHub)" <gi...@apache.org>.
style95 commented on issue #5433:
URL: https://github.com/apache/openwhisk/issues/5433#issuecomment-1677935552
There was already [a discussion thread](https://github.com/actions/runner-images/issues/2840) about this.
And [this action](https://github.com/marketplace/actions/maximize-build-disk-space) provides some options. I will try that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [openwhisk] style95 closed issue #5433: Multi-runtime tests keep failing
Posted by "style95 (via GitHub)" <gi...@apache.org>.
style95 closed issue #5433: Multi-runtime tests keep failing
URL: https://github.com/apache/openwhisk/issues/5433
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [openwhisk] style95 commented on issue #5433: Multi-runtime tests keep failing
Posted by "style95 (via GitHub)" <gi...@apache.org>.
style95 commented on issue #5433:
URL: https://github.com/apache/openwhisk/issues/5433#issuecomment-1677907727
I found the runner has run out of disk storage and all indices of elasticsearch became read-only.
```
[2023-08-14T18:14:58,169][WARN ][o.e.c.r.a.DiskThresholdMonitor] [elasticsearch0] flood stage disk watermark [95%] exceeded on [YH7WpgL_SryeZDBDLERQWw][elasticsearch0][/usr/share/elasticsearch/data/nodes/0] free: 1.6gb[2%], all indices on this node will be marked read-only
[2023-08-14T18:15:28,189][WARN ][o.e.c.r.a.DiskThresholdMonitor] [elasticsearch0] flood stage disk watermark [95%] exceeded on [YH7WpgL_SryeZDBDLERQWw][elasticsearch0][/usr/share/elasticsearch/data/nodes/0] free: 1.6gb[2%], all indices on this node will be marked read-only
```
```
# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/root 84G 82G 2.1G 98% /
tmpfs 3.4G 172K 3.4G 1% /dev/shm
tmpfs 1.4G 2.2M 1.4G 1% /run
tmpfs 5.0M 0 5.0M 0% /run/lock
/dev/sdb15 105M 6.1M 99M 6% /boot/efi
/dev/sda1 14G 4.1G 9.0G 31% /mnt
tmpfs 694M 12K 694M 1% /run/user/1001
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/d6165520e2290a7a9db42c600dade957a9a4bb3fc78e5e0d51ef9b073d090682/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/9f6eed5d5db3ae38aef2e316f3c29045e69b2c22201a5e6d5263ecfce9129000/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/5065e605931dc05e96adf45741517c82f366938c47185c0e56ce688dc0b397d1/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/7aa088b7a3eb55cbd2956b7a5046cd5ea79ce50b1fbaf909c161612162317b88/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/907fb22af7d540c8d3c4aa3ba73b44066f07b71bea6de2ef02ee510bdc61dc9b/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/6e67e35f10b798ef2e2cc8a92a25a406cc53dcd09a8a5c5f9f1cc6c59c575439/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/bb1417e3d32b4f41b1a06f0c6351322b338186b92c222195a9bafddcf0d2652e/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/294c017cb1dd49394625502d51517c0526e513a5b1d1b5470881bb3bed4022c3/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/439a7043ec55cb7b7258c8df18d86ddd121c5d2c044e19130be21a53181f9897/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/5b238ac22c0ef9f2e84acf5fc0fb5caffe8e5fbefb6f2963b0acd38eafd84b25/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/00dd53f8409f1e21fb28c36f2abf9ac114026e6fa6fc8e7cbc8b4b3d2d377f75/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/4fbb241cdd8df6605311cef23bf30305246a251879aec0fbe124125818a4c6e2/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/4b2421ad60cccc63a02f0aa6fbc208e06e12f7f6b7cbd3e57c93cd1093885c01/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/a8279a051ef469993ae1b7fee0b97182739e6b79d50733af6e95a29f126d13c2/merged
overlay 84G 82G 2.1G 98% /var/lib/docker/overlay2/0ae7eb16ecc7ed950559e4d31f57314be1ea0ca6195f9d86bf63d996e0b59430/merged
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [openwhisk] style95 commented on issue #5433: Multi-runtime tests keep failing
Posted by "style95 (via GitHub)" <gi...@apache.org>.
style95 commented on issue #5433:
URL: https://github.com/apache/openwhisk/issues/5433#issuecomment-1677968819
Since [the action](https://github.com/marketplace/actions/maximize-build-disk-space) is not allowed in the Apache repo, I tried [manually removing unnecessary tools](https://github.com/apache/openwhisk/pull/5436/files#diff-6e4b3d6fb44206eb74f4ea93097ae1b7bc8656459cdddba8cad249e0a53859d3R61).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org