You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Eugene Kirpichov (JIRA)" <ji...@apache.org> on 2017/11/29 22:03:01 UTC

[jira] [Commented] (BEAM-3267) Return file names from TFRecordIO write

    [ https://issues.apache.org/jira/browse/BEAM-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271612#comment-16271612 ] 

Eugene Kirpichov commented on BEAM-3267:
----------------------------------------

This should be solved by FileIO.write() and the followup work pretty soon.

> Return file names from TFRecordIO write
> ---------------------------------------
>
>                 Key: BEAM-3267
>                 URL: https://issues.apache.org/jira/browse/BEAM-3267
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Łukasz Gajowy
>            Assignee: Kenneth Knowles
>            Priority: Minor
>
> In TFRecordIO we cannot actually retrurn filename set while doing the write. It prevents us from creating pipelines that write and then read in the same pipeline. It was acomplished in TextIO - there's even an example use case in TextIOIT. Maybe we can do the same in TFRecordIO?
> See: https://github.com/apache/beam/blob/f8d8ff14c49e4dfb15541f4b73aa66513c9a9d23/sdks/java/io/file-based-io-tests/src/test/java/org/apache/beam/sdk/io/text/TextIOIT.java#L114



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)