You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Bryan Beaudreault (Jira)" <ji...@apache.org> on 2023/02/17 06:08:00 UTC

[jira] [Resolved] (HADOOP-18215) Enhance WritableName to be able to return aliases for classes that use serializers

     [ https://issues.apache.org/jira/browse/HADOOP-18215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bryan Beaudreault resolved HADOOP-18215.
----------------------------------------
    Fix Version/s: 3.4.0
                   3.3.9
     Release Note: If you have a SequenceFile with an old key or value class which has been renamed, you can use WritableName.addName to add an alias class. This functionality previously existed, but only worked for classes which extend Writable. It now works for any class, notably key or value classes which use io.serializations.
       Resolution: Fixed

Pushed to trunk and branch-3.3. Thanks all!

> Enhance WritableName to be able to return aliases for classes that use serializers
> ----------------------------------------------------------------------------------
>
>                 Key: HADOOP-18215
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18215
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Bryan Beaudreault
>            Assignee: Bryan Beaudreault
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 3.4.0, 3.3.9
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> WritableName allows users shim in aliases for writables, in the case where a SequenceFile was written with a Writable class that has since been renamed or moved to another package. However, this requires that the aliased class extend Writable. 
> Separately it's possible to configure jobs with keys and values which don't actually extend Writable. Instead they are meant to be serialized/deserialized using the serialization classes defined in {{io.serializations}} config.
> Unfortunately, the current implementation does not support these key/value classes. All we need to do to support this is remove the {{.asSubclass(Writable.class)}} as is already the case for the default.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org