You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Chamikara Madhusanka Jayalath (Jira)" <ji...@apache.org> on 2022/04/21 17:27:00 UTC

[jira] [Updated] (BEAM-12211) Add ability to configure empty file behavior in IOs

     [ https://issues.apache.org/jira/browse/BEAM-12211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chamikara Madhusanka Jayalath updated BEAM-12211:
-------------------------------------------------
    Status: Open  (was: Triage Needed)

> Add ability to configure empty file behavior in IOs
> ---------------------------------------------------
>
>                 Key: BEAM-12211
>                 URL: https://issues.apache.org/jira/browse/BEAM-12211
>             Project: Beam
>          Issue Type: New Feature
>          Components: io-java-files, io-py-common
>            Reporter: Daniel Oliveira
>            Priority: P3
>
> This is a general feature request based on frequent questions I see on Stack Overflow. I often see questions about how to get an empty file instead of no file when a PCollection is empty, or vice versa for IOs that create empty files. In other words, whichever approach is taken, there's users that will want the opposite approach.
> It seems the best approach here would be to add some kind of common code (FileIO maybe?) that could either open files for writing in Setup or lazily in ProcessElements.
> Regardless of the approach taken, this bug is basically for investigating this feature for feasibility and maybe holding sub-tasks/blocking bugs for tracking implementation.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)