You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Evgeniy (Jira)" <ji...@apache.org> on 2021/02/11 09:29:00 UTC

[jira] [Updated] (BEAM-11799) S3 options does not provided to boto3 client while using FlinkRunner and Beam worker pool container

     [ https://issues.apache.org/jira/browse/BEAM-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Evgeniy updated BEAM-11799:
---------------------------
    Component/s: io-py-aws

> S3 options does not provided to boto3 client while using FlinkRunner and Beam worker pool container
> ---------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-11799
>                 URL: https://issues.apache.org/jira/browse/BEAM-11799
>             Project: Beam
>          Issue Type: Bug
>          Components: beam-community, io-py-aws, runner-flink
>         Environment: Python 3.8
> TFX 0.27.0
> Beam 0.27.0
> Flink Cluster 1.10.1 with 2 slaves. One beam worker per each taskmanager
>            Reporter: Evgeniy
>            Assignee: Aizhamal Nurmamat kyzy
>            Priority: P2
>
> When i use FlinkRunner i got an error inside beam worker pool container. As you see by logs, s3 options are provided.
> Logs are available on https://gist.github.com/ferryvg/d6be9f5b1ca739bc378d7743cb1b8e07



--
This message was sent by Atlassian Jira
(v8.3.4#803005)