You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2020/10/24 17:10:02 UTC

[jira] [Updated] (BEAM-8900) Python SDK should stage only up-to-date versions of pipeline dependencies defined by requirements file.

     [ https://issues.apache.org/jira/browse/BEAM-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Beam JIRA Bot updated BEAM-8900:
--------------------------------
    Labels: stale-assigned starter  (was: starter)

> Python SDK should stage only up-to-date versions of pipeline dependencies defined by requirements file.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-8900
>                 URL: https://issues.apache.org/jira/browse/BEAM-8900
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>            Reporter: Valentyn Tymofieiev
>            Assignee: Ayoub Ennassiri
>            Priority: P3
>              Labels: stale-assigned, starter
>
> When staging pipeline dependencies specified in requirements.txt file and transitive deps, we stage entire content of requirements-cache directory on user's machine, which may include dependencies that were cached a while ago and are no longer needed. See [1] for discussion and some ideas how we can avoid staging packages we don't need.
> [1] https://lists.apache.org/thread.html/f99820489026a46160505ea9a4c8c4a0eabe8649143c1ee22b7088aa%40%3Cdev.beam.apache.org%3E



--
This message was sent by Atlassian Jira
(v8.3.4#803005)