You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ștefan Istrate (Jira)" <ji...@apache.org> on 2021/07/26 11:42:00 UTC

[jira] [Commented] (BEAM-7857) Portable Wordcount on Flink runner finishes but does not produce output files in DOCKER execution mode

    [ https://issues.apache.org/jira/browse/BEAM-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387261#comment-17387261 ] 

Ștefan Istrate commented on BEAM-7857:
--------------------------------------

I'm also trying to figure this out. Can't Docker mount a host folder to the container, so that the local and outside-of-docker filesystems interact properly? How can I achieve this with Beam?

> Portable Wordcount on Flink runner finishes but does not produce output files in DOCKER execution mode
> ------------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-7857
>                 URL: https://issues.apache.org/jira/browse/BEAM-7857
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink, sdk-py-core
>            Reporter: Valentyn Tymofieiev
>            Priority: P3
>              Labels: portability
>
> Repro steps:
> {noformat}
> ./gradlew :runners:flink:1.5:job-server:runShadow    
> ./gradlew :sdks:python:container:py3:docker
> rm -rf /tmp/py-wordcount-direct*
> ./gradlew :sdks:python:test-suites:portable:py35:portableWordCountBatch  -PjobEndpoint=localhost:8099 -PenvironmentType=DOCKER
> cat /tmp/py-wordcount-direct* # to verify results.
> # Output: No such file or directory
> {noformat}
> Switching to -PenvironmentType=LOOPBACK produces output.
> The issue is reproducible both on Py2 and Py3 on master.
> cc: [~altay] [~angoenka] [~ibzib] [~robertwb]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)