You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Daniel Oliveira (Jira)" <ji...@apache.org> on 2021/04/22 19:02:00 UTC

[jira] [Created] (BEAM-12211) Add ability to configure empty file behavior in IOs

Daniel Oliveira created BEAM-12211:
--------------------------------------

             Summary: Add ability to configure empty file behavior in IOs
                 Key: BEAM-12211
                 URL: https://issues.apache.org/jira/browse/BEAM-12211
             Project: Beam
          Issue Type: New Feature
          Components: io-java-files, io-py-common
            Reporter: Daniel Oliveira


This is a general feature request based on frequent questions I see on Stack Overflow. I often see questions about how to get an empty file instead of no file when a PCollection is empty, or vice versa for IOs that create empty files. In other words, whichever approach is taken, there's users that will want the opposite approach.

It seems the best approach here would be to add some kind of common code (FileIO maybe?) that could either open files for writing in Setup or lazily in ProcessElements.

Regardless of the approach taken, this bug is basically for investigating this feature for feasibility and maybe holding sub-tasks/blocking bugs for tracking implementation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)