You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 19:58:09 UTC
[GitHub] [beam] damccorm opened a new issue, #20866: Worker endpoints are unset in StartWorkerRequest.
damccorm opened a new issue, #20866:
URL: https://github.com/apache/beam/issues/20866
User reported that worker endpoints are unset when attempting to start a worker in a worker pool using Kubernetes. https://stackoverflow.com/questions/66498209/how-to-configure-beam-python-sdk-with-spark-in-a-kubernetes-environment
Starting worker with command ['/opt/apache/beam/boot', '\--id=1-1', '\--logging_endpoint=', '\--artifact_endpoint=', '\--provision_endpoint=', '\--control_endpoint=']
These endpoints are expected to be set to use localhost and some random allocated port. The server is started here: https://github.com/apache/beam/blob/b101064f18e71adb81c8fe6ba7beae53e9b13b08/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/control/DefaultJobBundleFactory.java#L672-L697
And the StartWorkerRequest is constructed here: https://github.com/apache/beam/blob/master/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/environment/ExternalEnvironmentFactory.java
Imported from Jira [BEAM-11957](https://issues.apache.org/jira/browse/BEAM-11957). Original Jira may contain additional context.
Reported by: ibzib.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] nitinlkoin1984 commented on issue #20866: Worker endpoints are unset in StartWorkerRequest.
Posted by GitBox <gi...@apache.org>.
nitinlkoin1984 commented on issue #20866:
URL: https://github.com/apache/beam/issues/20866#issuecomment-1299315170
Has this issue been fixed? These issues can be easily identified if devs do some integration testing
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org