[jira] [Commented] (BEAM-13734) Support cache directories that use GCS buckets

["Beam JIRA Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501439#comment-17501439 ] 

Beam JIRA Bot commented on BEAM-13734:
--------------------------------------

This issue is assigned but has not received an update in 30 days so it has been labeled "stale-assigned". If you are still working on the issue, please give an update and remove the label. If you are no longer working on the issue, please unassign so someone else may work on it. In 7 days the issue will be automatically unassigned.

> Support cache directories that use GCS buckets
> ----------------------------------------------
>
>                 Key: BEAM-13734
>                 URL: https://issues.apache.org/jira/browse/BEAM-13734
>             Project: Beam
>          Issue Type: New Feature
>          Components: runner-py-interactive
>            Reporter: Victor Chen
>            Assignee: Victor Chen
>            Priority: P2
>              Labels: stale-assigned
>          Time Spent: 17h 50m
>  Remaining Estimate: 0h
>
> * Builds off of the work accomplished under BEAM-13685
>  * Modified interactive_environment.py to support caching to a bucket on GCS for batch processing pipelines
>  * If a specified bucket does not exist, the pipeline will terminate and return an error specifying that the bucket does not exist
>  * Added cleanup() functionality to cache_manager.py, to enable the FileBasedCacheManager class to automatically delete cached values on GCS when a bucket path is specified
>  * Added docstring to interactive_beam.py with an example of GCS path assignment
>  * Cached files on GCS will be stored under a directory represented by the value of id(pipeline).
>  ** Example cached path: gs://my-gcs-bucket/cache/dir/id(pipeline)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)