You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@buildstream.apache.org by GitBox <gi...@apache.org> on 2022/07/12 11:00:47 UTC
[GitHub] [buildstream] jjardon opened a new issue, #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
jjardon opened a new issue, #1681:
URL: https://github.com/apache/buildstream/issues/1681
Some examples of this failure here:
- https://gitlab.com/freedesktop-sdk/freedesktop-sdk/-/jobs/2681685721
- https://gitlab.com/freedesktop-sdk/freedesktop-sdk/-/jobs/2687429185
This probably affects buildbox-casd, but as the timeouts are set by buildstream, we decided the primary issue to track this should be here
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] jjardon commented on issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by GitBox <gi...@apache.org>.
jjardon commented on issue #1681:
URL: https://github.com/apache/buildstream/issues/1681#issuecomment-1263972076
I think so, yes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] nanonyme commented on issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by GitBox <gi...@apache.org>.
nanonyme commented on issue #1681:
URL: https://github.com/apache/buildstream/issues/1681#issuecomment-1181980150
15 second timeout between sigterm and sigkill also seems a bit on the low side since it actually triggering will result in issues starting BuildStream next time. How about bumping this to one minute?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] nanonyme commented on issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by GitBox <gi...@apache.org>.
nanonyme commented on issue #1681:
URL: https://github.com/apache/buildstream/issues/1681#issuecomment-1263913658
@jjardon I guess this can be closed now?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] nanonyme commented on issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by GitBox <gi...@apache.org>.
nanonyme commented on issue #1681:
URL: https://github.com/apache/buildstream/issues/1681#issuecomment-1184206270
Yeah, I wasn't suggesting not fixing the actual performance issues.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] nanonyme commented on issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by GitBox <gi...@apache.org>.
nanonyme commented on issue #1681:
URL: https://github.com/apache/buildstream/issues/1681#issuecomment-1214328990
I'm leaning towards backporting the fix for freedesktop-sdk CI while we wait for merge and release. We seem to be still losing pipelines due to random errors when there's load.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] juergbi closed issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by "juergbi (via GitHub)" <gi...@apache.org>.
juergbi closed issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
URL: https://github.com/apache/buildstream/issues/1681
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] juergbi commented on issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by GitBox <gi...@apache.org>.
juergbi commented on issue #1681:
URL: https://github.com/apache/buildstream/issues/1681#issuecomment-1213276829
https://gitlab.com/BuildGrid/buildbox/buildbox-casd/-/merge_requests/274 should reduce buildbox-casd shutdown time in case of running cleanup.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] nanonyme commented on issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by "nanonyme (via GitHub)" <gi...@apache.org>.
nanonyme commented on issue #1681:
URL: https://github.com/apache/buildstream/issues/1681#issuecomment-1688466547
@jjardon I think you have permissions to close as the creator.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] jjardon commented on issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by GitBox <gi...@apache.org>.
jjardon commented on issue #1681:
URL: https://github.com/apache/buildstream/issues/1681#issuecomment-1181622109
For reference, some performance improvements that have alleviate the situation but not completely fixed it:
- https://github.com/apache/buildstream/pull/1678
- https://github.com/apache/buildstream/pull/1677
- https://github.com/apache/buildstream/pull/1680
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [buildstream] juergbi commented on issue #1681: bst2: CASCacheError: Timed out waiting for buildbox-casd to become ready
Posted by GitBox <gi...@apache.org>.
juergbi commented on issue #1681:
URL: https://github.com/apache/buildstream/issues/1681#issuecomment-1184138056
Bumping the timeout may be reasonable as it may prevent issues on next start and BuildStream at least already mentions what it's doing.
However, we should still improve the underlying issue. @abderrahim mentioned that a likely cause is BuildStream attempting to terminate buildbox-casd when buildbox-casd is in the middle of cache expiry and I agree. If that's indeed the case, we should modify buildbox-casd to stop cache expiry when receiving SIGTERM.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@buildstream.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org