You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Brandon Williams (Jira)" <ji...@apache.org> on 2021/10/18 17:36:00 UTC
[jira] [Comment Edited] (CASSANDRA-16954) Flaky tests due to
teardown failure
[ https://issues.apache.org/jira/browse/CASSANDRA-16954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430104#comment-17430104 ]
Brandon Williams edited comment on CASSANDRA-16954 at 10/18/21, 5:35 PM:
-------------------------------------------------------------------------
I think before CASSANDRA-16581 these exceptions were just ignored since they weren't ProtocolExceptions but now the catchall is logging this warning and causing the teardown failures. Patch to log native IO errors like these at trace instead.
||Branch||CI||
|[3.0|https://github.com/driftx/cassandra/tree/CASSANDRA-16954-3.0]|[circle|https://app.circleci.com/pipelines/github/driftx/cassandra?branch=CASSANDRA-16954-3.0], [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/1221/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/1221/pipeline]|
|[3.11|https://github.com/driftx/cassandra/tree/CASSANDRA-16954-3.11]|[circle|https://app.circleci.com/pipelines/github/driftx/cassandra?branch=CASSANDRA-16954-3.11], [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/1220/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/1220/pipeline]|
|[4.0|https://github.com/driftx/cassandra/tree/CASSANDRA-16954-4.0]|[circle|https://app.circleci.com/pipelines/github/driftx/cassandra?branch=CASSANDRA-16954-4.0], [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/1219/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/1219/pipeline]|
|[trunk|https://github.com/driftx/cassandra/tree/CASSANDRA-16954-trunk]|[circle|https://app.circleci.com/pipelines/github/driftx/cassandra?branch=CASSANDRA-16954-trunk], [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/1218/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/1218/pipeline]|
was (Author: brandon.williams):
I think before CASSANDRA-16581 these exceptions were just ignored since they weren't ProtocolExceptions but now the catchall is logging this warning and causing the teardown failures. Patch to log native IO errors like these at trace instead.
||Branch||CI||
|[3.11|https://github.com/driftx/cassandra/tree/CASSANDRA-16954-3.11]|[circle|https://app.circleci.com/pipelines/github/driftx/cassandra?branch=CASSANDRA-16954-3.11], [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/1220/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/1220/pipeline]|
|[4.0|https://github.com/driftx/cassandra/tree/CASSANDRA-16954-4.0]|[circle|https://app.circleci.com/pipelines/github/driftx/cassandra?branch=CASSANDRA-16954-4.0], [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/1219/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/1219/pipeline]|
|[trunk|https://github.com/driftx/cassandra/tree/CASSANDRA-16954-trunk]|[circle|https://app.circleci.com/pipelines/github/driftx/cassandra?branch=CASSANDRA-16954-trunk], [!https://ci-cassandra.apache.org/job/Cassandra-devbranch/1218/badge/icon!|https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-devbranch/detail/Cassandra-devbranch/1218/pipeline]|
> Flaky tests due to teardown failure
> -----------------------------------
>
> Key: CASSANDRA-16954
> URL: https://issues.apache.org/jira/browse/CASSANDRA-16954
> Project: Cassandra
> Issue Type: Bug
> Components: Test/dtest/python
> Reporter: Ruslan Fomkin
> Assignee: Brandon Williams
> Priority: Normal
> Labels: flaky-test
>
> Different dtests in several CircleCI builds failed with teardown failure due to network failure with the error:
> {code}
> test teardown failure
> Unexpected error found in node logs (see stdout for full details). Errors: [WARN [epollEventLoopGroup-5-4] 2021-09-14 09:35:15,897 ExceptionHandlers.java:134 - Unknown exception in client networking
> io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer, WARN [epollEventLoopGroup-5-4] 2021-09-14 09:35:15,897 ExceptionHandlers.java:134 - Unknown exception in client networking
> io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer]
> {code}
> For example, {{test_view_metadata_cleanup}} from {{materialized_views_test.TestMaterializedViews}} failed in [this build|https://app.circleci.com/pipelines/github/k-rus/cassandra/18/workflows/0cb193f3-ffe8-41c1-a376-43c91634579e/jobs/185/tests#failed-test-0] or {{test_expiration_overflow_policy_reject}} from {{ttl_test.TestTTL}} failed in [this build|https://app.circleci.com/pipelines/github/k-rus/cassandra/8/workflows/da99468d-c513-4a4f-9fd3-48b67482ce3e/jobs/67/tests#failed-test-0]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org