[GitHub] [beam] damccorm opened a new issue, #20945: Failure to connect to expansion service with GRPC local secure channel

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #20945:
URL: https://github.com/apache/beam/issues/20945

   There seem to be a discrepancy between how Beam Python SDK connects to the job endpoint and the artifact endpoint (where it always uses insecure GRPC connection), and the expansion service (where it [tries to use](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/transforms/external.py#L322) local secure channel if available in the GRPC module).
   
   This has caused an error to be thrown when trying to connect to a remote Flink cluster: 
   ```
   
   File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/transforms/ptransform.py",
   line 573, in __ror__
       result = p.apply(self, pvalueish, label)
     File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/pipeline.py",
   line 689, in apply
       pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
   
    File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/runners/runner.py",
   line 188, in apply
       return m(transform, input, options)
     File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/runners/runner.py",
   line 218, in apply_PTransform
       return transform.expand(input)
     File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/transforms/external.py",
   line 325, in expand
       response = service.Expand(request)
     File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/grpc/_channel.py",
   line 923, in __call__
       return _end_unary_response_blocking(state, call, False, None)
     File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/grpc/_channel.py",
   line 826, in _end_unary_response_blocking
       raise _InactiveRpcError(state)
   grpc._channel._InactiveRpcError:
   <_InactiveRpcError of RPC that terminated with:
           status = StatusCode.UNAVAILABLE
           details
   = "failed to connect to all addresses"
           debug_error_string = "{"created":"@1619629304.651319000","description":"Failed
   to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":5397,"referenced_errors":[{"created":"@1619629304.651278000","description":"failed
   to connect to all addresses","file":"src/core/ext/filters/client_channel/lb_policy/pick_first/pick_first.cc","file_line":398,"grpc_status":14}]}"
   
   ```
   
   
   I think all GRPC services (job, artifact, expansion) should use the same way to connect (currently insecure_channel)
   
   Imported from Jira [BEAM-12244](https://issues.apache.org/jira/browse/BEAM-12244). Original Jira may contain additional context.
   Reported by: nirga.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org