You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2021/07/28 17:22:01 UTC

[jira] [Updated] (BEAM-12545) WriteToFile should support mime/encoding.

     [ https://issues.apache.org/jira/browse/BEAM-12545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Beam JIRA Bot updated BEAM-12545:
---------------------------------
    Labels: stale-assigned  (was: )

> WriteToFile should support mime/encoding.
> -----------------------------------------
>
>                 Key: BEAM-12545
>                 URL: https://issues.apache.org/jira/browse/BEAM-12545
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-py-files
>    Affects Versions: 2.30.0
>            Reporter: Andreas Bergmeier
>            Assignee: Pablo Estrada
>            Priority: P3
>              Labels: stale-assigned
>
> For our use case, we need to write blobs to GCS. Also, we want to have both *{{Content-Type}}* and *{{Content-Encoding}}* set for these blobs.
>  Since *{{WriteToFiles}}* currently only calls *{{Filesystem.create}}* without *{{mime_type}}* and *{{compression_type}}*, the resulting blobs are of type octet-stream.
> We imagine this to look something like:
> {code:python}
>  metadata = sink.metadata()
>  full_file_name, writer = _create_writer(base_path=self.base_path.get(),
>  writer_key=(destination, w),
>  mime_type=metadata.mime_type,
>  compression_type=metadata.compression_type)
> {code}
> WDYT?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)