You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ankur Goenka (Jira)" <ji...@apache.org> on 2020/05/28 22:12:00 UTC

[jira] [Created] (BEAM-10147) Clean /tmp/dataflow-requirements-cache before downloading the requirements from requirements.txt

Ankur Goenka created BEAM-10147:
-----------------------------------

             Summary: Clean /tmp/dataflow-requirements-cache before downloading the requirements from requirements.txt
                 Key: BEAM-10147
                 URL: https://issues.apache.org/jira/browse/BEAM-10147
             Project: Beam
          Issue Type: Bug
          Components: runner-dataflow, sdk-py-core
            Reporter: Ankur Goenka


when using requirements.txt with beam pipelines, /tmp/dataflow-requirements-cache is not cleaned and all the new dependencies are downloaded and then all the files in /tmp/dataflow-requirements-cache  are staged which is wasteful and unecessary.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)