[jira] [Updated] (BEAM-11457) Enable skip key-value clone for HadoopFormatIO

["Alexey Romanenko (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-11457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Romanenko updated BEAM-11457:
------------------------------------
    Fix Version/s: 2.28.0
       Resolution: Fixed
           Status: Resolved  (was: Open)

> Enable skip key-value clone for HadoopFormatIO 
> -----------------------------------------------
>
>                 Key: BEAM-11457
>                 URL: https://issues.apache.org/jira/browse/BEAM-11457
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-hadoop-format
>    Affects Versions: 2.25.0
>            Reporter: Jozef Vilcek
>            Assignee: Jozef Vilcek
>            Priority: P3
>             Fix For: 2.28.0
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> HadoopFormatIO eagerly clone key-values if they are not a well known immutable types. This make sense due to how hadoop Writables behave. However, user can use key value translation functions which possibly already output immutable types. In such case it would be of benefit if extra clone via coder can be avoided.
> It would be great if coder can be consulted on the type an it's need for clone. However I am not aware if such detection is possible. I propose to add config parameter for skipping the clone which can be used by IO user.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)