[jira] [Created] (BEAM-13734) Support cache directories that use GCS buckets

["Victor Chen (Jira)" <ji...@apache.org>]

Victor Chen created BEAM-13734:
----------------------------------

             Summary: Support cache directories that use GCS buckets
                 Key: BEAM-13734
                 URL: https://issues.apache.org/jira/browse/BEAM-13734
             Project: Beam
          Issue Type: New Feature
          Components: runner-py-interactive
            Reporter: Victor Chen
            Assignee: Victor Chen


* A continuation of [[BEAM-13685]|https://issues.apache.org/jira/browse/BEAM-13685]
 * Modified interactive_environment.py to support caching to a bucket on GCS for batch processing pipelines
 ** If a specified bucket does not exist, the interactive_environment will attempt to create one under the given name
 * Cached files will be stored under a directory represented by id(pipeline).
 ** Example cached path: gs://my-gcs-bucket/cache/dir/id(pipeline)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)