You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "rangjiaheng (JIRA)" <ji...@apache.org> on 2017/10/10 02:27:00 UTC

[jira] [Created] (MAPREDUCE-6979) CLONE - MR task counters deserialized through RPC throws OutOfBoundsException if Counter enum class version not match

rangjiaheng created MAPREDUCE-6979:
--------------------------------------

             Summary: CLONE - MR task counters deserialized through RPC throws OutOfBoundsException if Counter enum class version not match
                 Key: MAPREDUCE-6979
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6979
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: mr-am, task
    Affects Versions: 3.0.0-alpha4
         Environment: NM1 TaskCounter.class old version; 
NM2 TaskCounter.class new version (new Enumeration values appended); 
            Reporter: rangjiaheng


Environment:
NM1 TaskCounter.class old version; 
NM2 TaskCounter.class new version (new Enumeration values appended); 

Result:
When an MR app's AM running on NM1, and it's containers on NM2; the containers on NM2 will all failed, AM cause OutOfBoundsException;

Reason:
When app running, containers will report their counters to AM through RPC, while the Container with new version TaskCounter.class will write more Counter values to RPC; however, the AM with old version TaskCounter.class which can not read them correctly from RPC.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org