You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "aravindh venkatesh (Jira)" <ji...@apache.org> on 2020/11/03 19:09:00 UTC

[jira] [Created] (BEAM-11186) Streaming - File name and Post processing file movement

aravindh venkatesh created BEAM-11186:
-----------------------------------------

             Summary: Streaming - File name and Post processing file movement
                 Key: BEAM-11186
                 URL: https://issues.apache.org/jira/browse/BEAM-11186
             Project: Beam
          Issue Type: Wish
          Components: io-java-gcp
            Reporter: aravindh venkatesh


E.g., while streaming files from GCS to BigQuery we usually provide wild card to match file name. Wish to get full file name at the time of processing (simple use case: to log which exact file is being processed).

Also once processed file to be moved to different folder within same bucket / different  bucket automatically.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)