You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "adoroszlai (via GitHub)" <gi...@apache.org> on 2026/07/13 09:39:40 UTC

[PR] HDDS-15786. Intermittent pipeline limit exceeded in debug tests [ozone]

adoroszlai opened a new pull request, #10738:
URL: https://github.com/apache/ozone/pull/10738

   ## What changes were proposed in this pull request?
   
   HDDS-14225 added new steps in debug acceptance test to restart datanodes, which caused intermittent failure:
   
   ```
   Stopping datanodes for a consistent container.db backup
   Restarting datanodes after backup
   ozonesecure-ha-datanode1-1 is HEALTHY
   ozonesecure-ha-datanode2-1 is HEALTHY
   ozonesecure-ha-datanode3-1 is HEALTHY
   ozonesecure-ha-datanode4-1 is HEALTHY
   ozonesecure-ha-datanode5-1 is HEALTHY
   ==============================================================================
   Ozone-Debug-Tests :: Test ozone debug CLI                                     
   ==============================================================================
   Test ozone debug replicas verify checksums, block-existence and co... | FAIL |
   Parent suite setup failed:
   255 != 0
   ```
   
   We need to wait for pipeline to be opened before proceeding with the test.  Same as #10722, but with reusable function (taken from `hadoop-ozone/dist/src/main/k8s/examples/testlib.sh`).
   
   https://issues.apache.org/jira/browse/HDDS-15786
   
   ## How was this patch tested?
   
   CI:
   https://github.com/adoroszlai/ozone/actions/runs/29234299846
   
   Tried to reproduce using `repeat-acceptance-test`, but did not encounter the problem with/without the patch:
   - https://github.com/adoroszlai/ozone/actions/runs/29230561004
   - https://github.com/adoroszlai/ozone/actions/runs/29232058791
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org


Re: [PR] HDDS-15786. Intermittent pipeline limit exceeded in debug tests [ozone]

Posted by "adoroszlai (via GitHub)" <gi...@apache.org>.
adoroszlai commented on PR #10738:
URL: https://github.com/apache/ozone/pull/10738#issuecomment-4959141418

   Thanks @dombizita for the review.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org


Re: [PR] HDDS-15786. Intermittent pipeline limit exceeded in debug tests [ozone]

Posted by "smengcl (via GitHub)" <gi...@apache.org>.
smengcl commented on PR #10738:
URL: https://github.com/apache/ozone/pull/10738#issuecomment-4962179732

   Thanks @adoroszlai for fixing this!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org


Re: [PR] HDDS-15786. Intermittent pipeline limit exceeded in debug tests [ozone]

Posted by "adoroszlai (via GitHub)" <gi...@apache.org>.
adoroszlai commented on PR #10738:
URL: https://github.com/apache/ozone/pull/10738#issuecomment-4959002918

   > `replicas-test.sh` is used in `ozonesecure-ha`, the kinit in `assert_pipeline_exists` is not needed because it already happens somewhere before?
   
   Yes, it happens here:
   
   https://github.com/apache/ozone/blob/c35148d85615560e8339c23f0e79be729a908d47/hadoop-ozone/dist/src/main/compose/ozonesecure-ha/test-debug-tools.sh#L47
   
   `kinit` is also assumed by the previous command:
   
   https://github.com/apache/ozone/blob/c35148d85615560e8339c23f0e79be729a908d47/hadoop-ozone/dist/src/main/compose/common/replicas-test.sh#L66
   
   https://github.com/apache/ozone/blob/c35148d85615560e8339c23f0e79be729a908d47/hadoop-ozone/dist/src/main/compose/testlib.sh#L618-L619


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org


Re: [PR] HDDS-15786. Intermittent pipeline limit exceeded in debug tests [ozone]

Posted by "adoroszlai (via GitHub)" <gi...@apache.org>.
adoroszlai merged PR #10738:
URL: https://github.com/apache/ozone/pull/10738


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org