[jira] [Work stopped] (BEAM-8900) Python SDK should stage only up-to-date versions of pipeline dependencies defined by requirements file.

["Valentyn Tymofieiev (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on BEAM-8900 stopped by Valentyn Tymofieiev.
-------------------------------------------------
> Python SDK should stage only up-to-date versions of pipeline dependencies defined by requirements file.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-8900
>                 URL: https://issues.apache.org/jira/browse/BEAM-8900
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>            Reporter: Valentyn Tymofieiev
>            Priority: P3
>              Labels: starter
>
> When staging pipeline dependencies specified in requirements.txt file and transitive deps, we stage entire content of requirements-cache directory on user's machine, which may include dependencies that were cached a while ago and are no longer needed. See [1] for discussion and some ideas how we can avoid staging packages we don't need.
> [1] https://lists.apache.org/thread.html/f99820489026a46160505ea9a4c8c4a0eabe8649143c1ee22b7088aa%40%3Cdev.beam.apache.org%3E



--
This message was sent by Atlassian Jira
(v8.20.1#820001)