You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2021/07/28 17:22:01 UTC
[jira] [Updated] (BEAM-12545) WriteToFile should support
mime/encoding.
[ https://issues.apache.org/jira/browse/BEAM-12545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Beam JIRA Bot updated BEAM-12545:
---------------------------------
Labels: stale-assigned (was: )
> WriteToFile should support mime/encoding.
> -----------------------------------------
>
> Key: BEAM-12545
> URL: https://issues.apache.org/jira/browse/BEAM-12545
> Project: Beam
> Issue Type: Improvement
> Components: io-py-files
> Affects Versions: 2.30.0
> Reporter: Andreas Bergmeier
> Assignee: Pablo Estrada
> Priority: P3
> Labels: stale-assigned
>
> For our use case, we need to write blobs to GCS. Also, we want to have both *{{Content-Type}}* and *{{Content-Encoding}}* set for these blobs.
> Since *{{WriteToFiles}}* currently only calls *{{Filesystem.create}}* without *{{mime_type}}* and *{{compression_type}}*, the resulting blobs are of type octet-stream.
> We imagine this to look something like:
> {code:python}
> metadata = sink.metadata()
> full_file_name, writer = _create_writer(base_path=self.base_path.get(),
> writer_key=(destination, w),
> mime_type=metadata.mime_type,
> compression_type=metadata.compression_type)
> {code}
> WDYT?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)