[jira] [Work logged] (BEAM-12244) Failure to connect to expansion service with GRPC local secure channel

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-12244?focusedWorklogId=700250&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-700250 ]

ASF GitHub Bot logged work on BEAM-12244:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 22/Dec/21 20:52
            Start Date: 22/Dec/21 20:52
    Worklog Time Spent: 10m 
      Work Description: parthshah86 commented on pull request #14671:
URL: https://github.com/apache/beam/pull/14671#issuecomment-999873028


   @chamikaramj @nirga bump on this PR, it's been stale for a few months now. Can we please decide on the fix, we are currently maintaining a patch for this in our source code.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 700250)
    Time Spent: 5h 10m  (was: 5h)

> Failure to connect to expansion service with GRPC local secure channel
> ----------------------------------------------------------------------
>
>                 Key: BEAM-12244
>                 URL: https://issues.apache.org/jira/browse/BEAM-12244
>             Project: Beam
>          Issue Type: Bug
>          Components: cross-language, io-py-kafka
>            Reporter: Nir Gazit
>            Priority: P3
>          Time Spent: 5h 10m
>  Remaining Estimate: 0h
>
> There seem to be a discrepancy between how Beam Python SDK connects to the job endpoint and the artifact endpoint (where it always uses insecure GRPC connection), and the expansion service (where it [tries to use|https://github.com/apache/beam/blob/master/sdks/python/apache_beam/transforms/external.py#L322] local secure channel if available in the GRPC module).
> This has caused an error to be thrown when trying to connect to a remote Flink cluster: 
> {code:none}
> File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/transforms/ptransform.py", line 573, in __ror__
>     result = p.apply(self, pvalueish, label)
>   File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/pipeline.py", line 689, in apply
>     pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
>   File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/runners/runner.py", line 188, in apply
>     return m(transform, input, options)
>   File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/runners/runner.py", line 218, in apply_PTransform
>     return transform.expand(input)
>   File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/apache_beam/transforms/external.py", line 325, in expand
>     response = service.Expand(request)
>   File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/grpc/_channel.py", line 923, in __call__
>     return _end_unary_response_blocking(state, call, False, None)
>   File "/Users/nir.gazit/.pyenv/versions/beam/lib/python3.7/site-packages/grpc/_channel.py", line 826, in _end_unary_response_blocking
>     raise _InactiveRpcError(state)
> grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
>         status = StatusCode.UNAVAILABLE
>         details = "failed to connect to all addresses"
>         debug_error_string = "{"created":"@1619629304.651319000","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":5397,"referenced_errors":[{"created":"@1619629304.651278000","description":"failed to connect to all addresses","file":"src/core/ext/filters/client_channel/lb_policy/pick_first/pick_first.cc","file_line":398,"grpc_status":14}]}"
> {code}
> I think all GRPC services (job, artifact, expansion) should use the same way to connect (currently insecure_channel)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)