You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2019/01/03 17:05:00 UTC

[jira] [Updated] (BEAM-5310) Add support of HadoopOutputFormatIO

     [ https://issues.apache.org/jira/browse/BEAM-5310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kenneth Knowles updated BEAM-5310:
----------------------------------
    Fix Version/s:     (was: 2.10.0)

> Add support of HadoopOutputFormatIO
> -----------------------------------
>
>                 Key: BEAM-5310
>                 URL: https://issues.apache.org/jira/browse/BEAM-5310
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-hadoop
>            Reporter: Alexey Romanenko
>            Assignee: Alexey Romanenko
>            Priority: Minor
>
> For the moment, there is only {{HadoopInputFormatIO}} in Beam. To provide a support of different writing IOs, that are not yet natively supported in Beam (for example, Apache Orc or HBase bulk load), it would make sense to add {{HadoopOutputFormatIO}} as well. It will incorporate support of batching and streaming processing.
> After, {{HadoopInputFormatIO}} and {{HadoopOutputFormatIO}} should be merged into one module, called {{HadoopFormatIO}}. Old {{HadoopInputFormatIO}} should become deprecated.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)