You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ștefan Istrate (Jira)" <ji...@apache.org> on 2021/07/26 11:42:00 UTC
[jira] [Commented] (BEAM-7857) Portable Wordcount on Flink runner
finishes but does not produce output files in DOCKER execution mode
[ https://issues.apache.org/jira/browse/BEAM-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387261#comment-17387261 ]
Ștefan Istrate commented on BEAM-7857:
--------------------------------------
I'm also trying to figure this out. Can't Docker mount a host folder to the container, so that the local and outside-of-docker filesystems interact properly? How can I achieve this with Beam?
> Portable Wordcount on Flink runner finishes but does not produce output files in DOCKER execution mode
> ------------------------------------------------------------------------------------------------------
>
> Key: BEAM-7857
> URL: https://issues.apache.org/jira/browse/BEAM-7857
> Project: Beam
> Issue Type: Bug
> Components: runner-flink, sdk-py-core
> Reporter: Valentyn Tymofieiev
> Priority: P3
> Labels: portability
>
> Repro steps:
> {noformat}
> ./gradlew :runners:flink:1.5:job-server:runShadow
> ./gradlew :sdks:python:container:py3:docker
> rm -rf /tmp/py-wordcount-direct*
> ./gradlew :sdks:python:test-suites:portable:py35:portableWordCountBatch -PjobEndpoint=localhost:8099 -PenvironmentType=DOCKER
> cat /tmp/py-wordcount-direct* # to verify results.
> # Output: No such file or directory
> {noformat}
> Switching to -PenvironmentType=LOOPBACK produces output.
> The issue is reproducible both on Py2 and Py3 on master.
> cc: [~altay] [~angoenka] [~ibzib] [~robertwb]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)