You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "weidong5 (via GitHub)" <gi...@apache.org> on 2023/02/20 14:07:32 UTC
[GitHub] [hop] weidong5 opened a new issue, #2447: [Task]: How to use "Beam Kafka Consume"?
weidong5 opened a new issue, #2447:
URL: https://github.com/apache/hop/issues/2447
### What needs to happen?
I filled the form as such:
there is no erro in logs , but also nothing happened .
kafka gui shows that the 's' group is empty.
### Issue Priority
Priority: 3
### Issue Component
Component: Beam
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hop] bamaer commented on issue #2447: [Task]: How to use "Beam Kafka Consume"?
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
bamaer commented on issue #2447:
URL: https://github.com/apache/hop/issues/2447#issuecomment-1437382471
it has been used in real-life projects, but unfortunately, we don't have any samples or integration tests for this transform yet.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hop] bamaer commented on issue #2447: [Task]: How to use "Beam Kafka Consume"?
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
bamaer commented on issue #2447:
URL: https://github.com/apache/hop/issues/2447#issuecomment-1437274230
are you running on a Beam environment (Spark, Flink, Dataflow)? if not, the native [Kafka Consumer](https://hop.apache.org/manual/latest/pipeline/transforms/kafkaconsumer.html) may be what you're looking for.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hop] bamaer commented on issue #2447: [Task]: How to use "Beam Kafka Consume"?
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
bamaer commented on issue #2447:
URL: https://github.com/apache/hop/issues/2447#issuecomment-1437219207
looks like there's nothing for the (Beam) Kafka Consumer to read, so this behavior seems correct.
does this work correctly when you write some messages to your Kafka cluster?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hop] RunInSpace-Wei commented on issue #2447: [Task]: How to use "Beam Kafka Consume"?
Posted by "RunInSpace-Wei (via GitHub)" <gi...@apache.org>.
RunInSpace-Wei commented on issue #2447:
URL: https://github.com/apache/hop/issues/2447#issuecomment-1437230992
> looks like there's nothing for the (Beam) Kafka Consumer to read, so this behavior seems correct.
> does this work correctly when you write some messages to your Kafka cluster?
Thanks for your answer. no，it doesn’t work .when i send some messages to Kafka，nothing happened in hop. But if i start a consumer thread using Kafka command , the messages would be consumed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hop] RunInSpace-Wei commented on issue #2447: [Task]: How to use "Beam Kafka Consume"?
Posted by "RunInSpace-Wei (via GitHub)" <gi...@apache.org>.
RunInSpace-Wei commented on issue #2447:
URL: https://github.com/apache/hop/issues/2447#issuecomment-1437282378
> are you running on a Beam environment (Spark, Flink, Dataflow)? if not, the native [Kafka Consumer](https://hop.apache.org/manual/latest/pipeline/transforms/kafkaconsumer.html) may be what you're looking for.
i ran it on beam environment（Derect）. i can successfully run Beam Kafka produce. Have you ever used Beam Kafka consume? can you show me an example for this transform?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org