You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Thomas Weise (Jira)" <ji...@apache.org> on 2019/11/26 19:54:00 UTC
[jira] [Commented] (BEAM-8815) Portable pipeline execution without
artifact staging
[ https://issues.apache.org/jira/browse/BEAM-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982811#comment-16982811 ]
Thomas Weise commented on BEAM-8815:
------------------------------------
[~Ardagan] I'm marking this ticket for 2.17 just so that you see it and decide to merge the PR or not.
> Portable pipeline execution without artifact staging
> ----------------------------------------------------
>
> Key: BEAM-8815
> URL: https://issues.apache.org/jira/browse/BEAM-8815
> Project: Beam
> Issue Type: Task
> Components: runner-core, runner-flink
> Affects Versions: 2.17.0
> Reporter: Thomas Weise
> Assignee: Thomas Weise
> Priority: Major
> Labels: portability
> Fix For: 2.17.0
>
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> The default artifact staging implementation relies on a distributed filesystem. A directory and manifest will be created even when artifact staging isn't used, and the container boot code will fail retrieving artifacts, even though there are non. In a containerized environment it is common to package artifacts into containers. It should be possible to run the pipeline w/o a distributed filesystem.
> [https://lists.apache.org/thread.html/1b0d545955a80688ea19f227ad943683747b17beb45368ad0908fd21@%3Cdev.beam.apache.org%3E]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)