You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Thomas Weise (Jira)" <ji...@apache.org> on 2019/11/23 17:16:00 UTC

[jira] [Created] (BEAM-8815) Portable pipeline execution without artifact staging

Thomas Weise created BEAM-8815:
----------------------------------

             Summary: Portable pipeline execution without artifact staging
                 Key: BEAM-8815
                 URL: https://issues.apache.org/jira/browse/BEAM-8815
             Project: Beam
          Issue Type: Task
          Components: runner-core, runner-flink
    Affects Versions: 2.17.0
            Reporter: Thomas Weise


The default artifact staging implementation relies on a distributed filesystem. A directory and manifest will be created even when artifact staging isn't used, and the container boot code will fail retrieving artifacts, even though there are non. In a containerized environment it is common to package artifacts into containers. It should be possible to run the pipeline w/o a distributed filesystem. 

[https://lists.apache.org/thread.html/1b0d545955a80688ea19f227ad943683747b17beb45368ad0908fd21@%3Cdev.beam.apache.org%3E]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)