You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/08/05 13:17:51 UTC
[GitHub] [beam] imadmoussa1 opened a new issue, #22606: [Bug]:
imadmoussa1 opened a new issue, #22606:
URL: https://github.com/apache/beam/issues/22606
### What happened?
Hello,
I was trying to use the WriteToKafka from apache_beam.io.kafka. Evrything in pipeline is working but when I added the WriteToKafka I have
`
raise RuntimeError(
RuntimeError: Service failed to start up with error 1
`
After checking the documentation I found that I need to use this because the Kafka in an extremal multi cross packages
`python apache_beam/runners/portability/expansion_service_main.py -p 18089 --fully_qualified_name_glob "*"`
while running this I have a different error:
` signal.pause()
AttributeError: module 'signal' has no attribute 'pause'`
can you help with this problem ? I am using beam 2.4.0
### Issue Priority
Priority: 0
### Issue Component
Component: io-py-kafka
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] TheNeuralBit commented on issue #22606: [Bug]: The pipeline fails when trying to write to kafka
Posted by GitBox <gi...@apache.org>.
TheNeuralBit commented on issue #22606:
URL: https://github.com/apache/beam/issues/22606#issuecomment-1212224095
It looks like that might be an issue in the Python expansion service, which we should track down (the full stacktrace for the signal.pause error would help here). But that shouldn't actually block your specific application. In your case you'll need a Java expansion service (since KafkaIO is a Java transform). If you can share the full stacktrace for the first RuntimeError you got we can help diagnose the issue there. One possible cause: do you have Java installed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] johnjcasey commented on issue #22606: [Bug]: The pipeline fails when trying to write to kafka
Posted by GitBox <gi...@apache.org>.
johnjcasey commented on issue #22606:
URL: https://github.com/apache/beam/issues/22606#issuecomment-1232000751
Has updating the expansion service resolved the issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] imadmoussa1 commented on issue #22606: [Bug]: The pipeline fails when trying to write to kafka
Posted by GitBox <gi...@apache.org>.
imadmoussa1 commented on issue #22606:
URL: https://github.com/apache/beam/issues/22606#issuecomment-1232958435
yes the problem was resolved, Thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] imadmoussa1 commented on issue #22606: [Bug]: The pipeline fails when trying to write to kafka
Posted by GitBox <gi...@apache.org>.
imadmoussa1 commented on issue #22606:
URL: https://github.com/apache/beam/issues/22606#issuecomment-1212203244
Yes , I am trying to run the pipeline on windows machine
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] johnjcasey closed issue #22606: [Bug]: The pipeline fails when trying to write to kafka
Posted by GitBox <gi...@apache.org>.
johnjcasey closed issue #22606: [Bug]: The pipeline fails when trying to write to kafka
URL: https://github.com/apache/beam/issues/22606
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] imadmoussa1 commented on issue #22606: [Bug]: The pipeline fails when trying to write to kafka
Posted by GitBox <gi...@apache.org>.
imadmoussa1 commented on issue #22606:
URL: https://github.com/apache/beam/issues/22606#issuecomment-1222003734
Yes I am running the java expansion service, and it seems I had this problem because I was using different java version.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] TheNeuralBit commented on issue #22606: [Bug]: The pipeline fails when trying to write to kafka
Posted by GitBox <gi...@apache.org>.
TheNeuralBit commented on issue #22606:
URL: https://github.com/apache/beam/issues/22606#issuecomment-1212200196
Hi @imadmoussa1, according to the Python docs [`signal.pause` is unix only](https://docs.python.org/3/library/signal.html#signal.pause). Are you running on a non-unix environment?
Also could you share the full stacktrace, so we can see where this method is accessed from?
CC: @johnjcasey
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org