You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 16:34:06 UTC
[GitHub] [beam] damccorm opened a new issue, #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
damccorm opened a new issue, #20333:
URL: https://github.com/apache/beam/issues/20333
For example,
[https://builds.apache.org/view/A-D/view/Beam/view/PerformanceTests/job/beam_PerformanceTests_Kafka_IO/514/console](https://builds.apache.org/view/A-D/view/Beam/view/PerformanceTests/job/beam_PerformanceTests_Kafka_IO/514/console)
18:55:33 Error from server (Invalid): error when creating "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Kafka_IO/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml": Service "outside-0" is invalid: spec.ports[0].nodePort: Invalid value: 32400: provided port is already allocated
18:55:33 Error from server (Invalid): error when creating "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Kafka_IO/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml": Service "outside-1" is invalid: spec.ports[0].nodePort: Invalid value: 32401: provided port is already allocated
18:55:33 Error from server (Invalid): error when creating "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Kafka_IO/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml": Service "outside-2" is invalid: spec.ports[0].nodePort: Invalid value: 32402: provided port is already allocated
1
Seems like we tried three ports but they were being used. Probably we should update code to find an unused port dynamically.
Imported from Jira [BEAM-9482](https://issues.apache.org/jira/browse/BEAM-9482). Original Jira may contain additional context.
Reported by: chamikara.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #20333:
URL: https://github.com/apache/beam/issues/20333#issuecomment-1244491675
Seems like tests are still flaky (regardless the failed test) that it may stuck at "waitForJob job.batch/kafka-config-eff079ec 40m".
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #20333:
URL: https://github.com/apache/beam/issues/20333#issuecomment-1146651059
Unable to assign user @benWize. If able, self-assign, otherwise tag @damccorm so that he can assign you. Because of GitHub's spam prevention system, your activity is required to enable assignment in this repo.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] benWize commented on issue #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
Posted by GitBox <gi...@apache.org>.
benWize commented on issue #20333:
URL: https://github.com/apache/beam/issues/20333#issuecomment-1244589315
>
Hi @Abacn, I think the current failures could be related to a problem with the availability of resources on the shared cluster(io-datastores). The Kubernetes console for kafka-1 pods shows a message: `Cannot schedule pods: Insufficient memory.`
We could provide more resources or double-check if some of the running workloads aren't terminated correctly (none of them are related to Kafka tests).
There are multiple namespaces created 11d ago, with the format: `beam-performancetests-*` that could be starving the resources.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #20333:
URL: https://github.com/apache/beam/issues/20333#issuecomment-1257321478
.close-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #20333:
URL: https://github.com/apache/beam/issues/20333#issuecomment-1257321449
Thanks @benWize cleaned up those namespaces and along with other fixes kafka performance test now works
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] github-actions[bot] closed issue #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
URL: https://github.com/apache/beam/issues/20333
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #20333:
URL: https://github.com/apache/beam/issues/20333#issuecomment-1147740894
Thanks! FWIW, once https://github.com/apache/beam/pull/21719 is merged you'll be able to self-assign by commenting `.take-issue` (and close by commenting `.close-issue`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] benWize commented on issue #20333: beam_PerformanceTests_Kafka_IO failing due to " provided port is already allocated"
Posted by GitBox <gi...@apache.org>.
benWize commented on issue #20333:
URL: https://github.com/apache/beam/issues/20333#issuecomment-1147737297
Working on this one. Associated PR is https://github.com/apache/beam/pull/17727
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org