You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Eugene Kirpichov (JIRA)" <ji...@apache.org> on 2018/01/25 20:25:00 UTC

[jira] [Closed] (BEAM-3267) Return file names from TFRecordIO write

     [ https://issues.apache.org/jira/browse/BEAM-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eugene Kirpichov closed BEAM-3267.
----------------------------------
       Resolution: Fixed
    Fix Version/s: 2.3.0

FileIO.write() is in, and support for it in TFRecordIO is in as well.

> Return file names from TFRecordIO write
> ---------------------------------------
>
>                 Key: BEAM-3267
>                 URL: https://issues.apache.org/jira/browse/BEAM-3267
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Łukasz Gajowy
>            Assignee: Eugene Kirpichov
>            Priority: Minor
>             Fix For: 2.3.0
>
>
> In TFRecordIO we cannot actually retrurn filename set while doing the write. It prevents us from creating pipelines that write and then read in the same pipeline. It was acomplished in TextIO - there's even an example use case in TextIOIT. Maybe we can do the same in TFRecordIO?
> See: https://github.com/apache/beam/blob/f8d8ff14c49e4dfb15541f4b73aa66513c9a9d23/sdks/java/io/file-based-io-tests/src/test/java/org/apache/beam/sdk/io/text/TextIOIT.java#L114



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)