You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/07/09 15:44:00 UTC
[jira] [Work logged] (BEAM-4742) Allow custom docker-image in
portable wordcount example
[ https://issues.apache.org/jira/browse/BEAM-4742?focusedWorklogId=120818&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-120818 ]
ASF GitHub Bot logged work on BEAM-4742:
----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Jul/18 15:43
Start Date: 09/Jul/18 15:43
Worklog Time Spent: 10m
Work Description: ryan-williams opened a new pull request #5902: [BEAM-4742] allow custom docker image in portable runner
URL: https://github.com/apache/beam/pull/5902
Allow specifying a docker image for the portable runner to use, via `DOCKER_IMAGE` env var
Also: make output directory in wordcount example, if it doesn't exist.
R: @angoenka
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/) | --- | --- | --- | --- | --- | ---
Java | [](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | --- | --- | --- | ---
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 120818)
Time Spent: 10m
Remaining Estimate: 0h
> Allow custom docker-image in portable wordcount example
> -------------------------------------------------------
>
> Key: BEAM-4742
> URL: https://issues.apache.org/jira/browse/BEAM-4742
> Project: Beam
> Issue Type: Improvement
> Components: examples-python
> Affects Versions: 2.5.0
> Reporter: Ryan Williams
> Assignee: Ryan Williams
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> I hit a couple snags [running the portable wordcount example|https://github.com/apache/beam/blob/997ee3afe74483ae44e2dcb32ca0e24876129cd9/sdks/python/build.gradle#L200-L214]:
> * [the default docker image is hard-coded to a bintray URL|https://github.com/apache/beam/blob/997ee3afe74483ae44e2dcb32ca0e24876129cd9/sdks/python/apache_beam/runners/portability/portable_runner.py#L60-L68], but I published my image to Docker Hub
> * the default output path is in a temporary directory that doesn't exist at the time of the {{open}} call, so I got {{IOError: [Errno 2] No such file or directory}}
> I'll send a PR with fixes to each of these shortly.
> I've also not found where to observe output from successfully running the example.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)