You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Valentyn Tymofieiev (Jira)" <ji...@apache.org> on 2021/10/15 17:33:00 UTC
[jira] [Commented] (BEAM-10147) Clean
/tmp/dataflow-requirements-cache before downloading the requirements from
requirements.txt
[ https://issues.apache.org/jira/browse/BEAM-10147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17429435#comment-17429435 ]
Valentyn Tymofieiev commented on BEAM-10147:
--------------------------------------------
Previously discussed at https://issues.apache.org/jira/browse/BEAM-680
> Clean /tmp/dataflow-requirements-cache before downloading the requirements from requirements.txt
> ------------------------------------------------------------------------------------------------
>
> Key: BEAM-10147
> URL: https://issues.apache.org/jira/browse/BEAM-10147
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow, sdk-py-core
> Reporter: Ankur Goenka
> Priority: P3
>
> when using requirements.txt with beam pipelines, /tmp/dataflow-requirements-cache is not cleaned and all the new dependencies are downloaded and then all the files in /tmp/dataflow-requirements-cache are staged which is wasteful and unecessary.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)