You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2021/03/10 21:44:00 UTC
[jira] [Created] (BEAM-11957) Worker endpoints are unset in
StartWorkerRequest.
Kyle Weaver created BEAM-11957:
----------------------------------
Summary: Worker endpoints are unset in StartWorkerRequest.
Key: BEAM-11957
URL: https://issues.apache.org/jira/browse/BEAM-11957
Project: Beam
Issue Type: Bug
Components: java-fn-execution
Reporter: Kyle Weaver
Assignee: Kyle Weaver
User reported that worker endpoints are unset when attempting to start a worker in a worker pool using Kubernetes. https://stackoverflow.com/questions/66498209/how-to-configure-beam-python-sdk-with-spark-in-a-kubernetes-environment
Starting worker with command ['/opt/apache/beam/boot', '--id=1-1', '--logging_endpoint=', '--artifact_endpoint=', '--provision_endpoint=', '--control_endpoint=']
These endpoints are expected to be set to use localhost and some random allocated port. The server is started here: https://github.com/apache/beam/blob/b101064f18e71adb81c8fe6ba7beae53e9b13b08/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/control/DefaultJobBundleFactory.java#L672-L697
And the StartWorkerRequest is constructed here: https://github.com/apache/beam/blob/master/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/environment/ExternalEnvironmentFactory.java
--
This message was sent by Atlassian Jira
(v8.3.4#803005)