You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by "kfaraz (via GitHub)" <gi...@apache.org> on 2025/08/29 07:38:09 UTC
[PR] Use apache/kafka image instead of bitnami (druid)
kfaraz opened a new pull request, #18454:
URL: https://github.com/apache/druid/pull/18454
### Description
Pull of the bitnami/kafka image seems to be failing recently:
```
kafka Error manifest for bitnami/kafka:4.0.0 not found: manifest unknown: manifest unknown
```
Example run:
https://github.com/apache/druid/actions/runs/17288422541/job/49162653293?pr=18436
Using the `apache/kafka:4.0.0` image instead as it is already being used in embedded tests `KafkaResource`.
<hr>
This PR has:
- [ ] been self-reviewed.
- [ ] using the [concurrency checklist](https://github.com/apache/druid/blob/master/dev/code-review/concurrency.md) (Remove this item if the PR doesn't have any relation to concurrency.)
- [ ] added documentation for new or modified features or behaviors.
- [ ] a release note entry in the PR description.
- [ ] added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
- [ ] added or updated version, license, or notice information in [licenses.yaml](https://github.com/apache/druid/blob/master/dev/license.md)
- [ ] added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
- [ ] added unit tests or modified existing tests to cover new code paths, ensuring the threshold for [code coverage](https://github.com/apache/druid/blob/master/dev/code-review/code-coverage.md) is met.
- [ ] added integration tests.
- [ ] been tested in a test Druid cluster.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
Re: [PR] Use apache/kafka image instead of bitnami (druid)
Posted by "kfaraz (via GitHub)" <gi...@apache.org>.
kfaraz commented on PR #18454:
URL: https://github.com/apache/druid/pull/18454#issuecomment-3237550320
Thanks for reviewing, @abhishekrb19 !
I will take a look tomorrow morning and resolve this, either by fixing the IT issue or preferably by converting it to an embedded test.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
Re: [PR] Use apache/kafka image instead of bitnami (druid)
Posted by "kfaraz (via GitHub)" <gi...@apache.org>.
kfaraz closed pull request #18454: Use apache/kafka image instead of bitnami
URL: https://github.com/apache/druid/pull/18454
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
Re: [PR] Use apache/kafka image instead of bitnami (druid)
Posted by "kfaraz (via GitHub)" <gi...@apache.org>.
kfaraz commented on PR #18454:
URL: https://github.com/apache/druid/pull/18454#issuecomment-3242813206
closing this PR for now, will create a separate one for the IT migration
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
Re: [PR] Use apache/kafka image instead of bitnami (druid)
Posted by "abhishekrb19 (via GitHub)" <gi...@apache.org>.
abhishekrb19 commented on PR #18454:
URL: https://github.com/apache/druid/pull/18454#issuecomment-3237460560
Thanks, @kfaraz. It looks like those manifest not found errors are gone with the image change. But those ITs are still failing because the Kafka containers aren't coming up successfully:
```
2025-08-29T12:56:09.9758874Z 2025-08-29T12:56:09,940 WARN [kafka-admin-client-thread | adminclient-1] org.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9094) could not be established. Node may not be available.
2025-08-29T12:56:10.0715860Z 2025-08-29T12:56:10,044 INFO [kafka-admin-client-thread | adminclient-1] org.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-1] Node -1 disconnected.
2025-08-29T12:56:10.0717785Z 2025-08-29T12:56:10,044 WARN [kafka-admin-client-thread | adminclient-1] org.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-1] Connection to node -1 (localhost/127.0.0.1:9094) could not be established. Node may not be available.
2025-08-29T12:57:10.1211245Z [ERROR] org.apache.druid.testsEx.DruidExactCountBitmap.ITDruidExactCountBitmapTest.testQuery Time elapsed: 67.768 s <<< ERROR!
2025-08-29T12:57:10.1213775Z java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: createTopics
2025-08-29T12:57:10.1217123Z at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396)
2025-08-29T12:57:10.1220534Z at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073)
...
java.lang.RuntimeException: org.apache.druid.rpc.ServiceNotAvailableException: Service [coordinator] is not available
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org