You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Keith Turner (Jira)" <ji...@apache.org> on 2021/01/19 17:29:00 UTC

[jira] [Created] (MAPREDUCE-7318) Possible Integer Overflow in MapTask.java

Keith Turner created MAPREDUCE-7318:
---------------------------------------

             Summary: Possible Integer Overflow in MapTask.java
                 Key: MAPREDUCE-7318
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7318
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 3.2.2, 3.1.4, 3.3.0
            Reporter: Keith Turner


The following code may overflow when the number of reduce task is large and the MR sortmb setting is close to 2G.  In the expression kvbuffer.length, partitions, , and APPROX_HEADER_LENGTH are all integers.  The expression assigns to a long, but the conversion to long would occur after the expression was evaluated and integer overflow may have occurred.

https://github.com/apache/hadoop/blob/1e877761e8dadd71effef30e592368f7fe66a61b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/MapTask.java#L1713



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org