[jira] [Work logged] (MAPREDUCE-7392) bug for GzipCodec in native task

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-7392?focusedWorklogId=784120&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-784120 ]

ASF GitHub Bot logged work on MAPREDUCE-7392:
---------------------------------------------

                Author: ASF GitHub Bot
            Created on: 23/Jun/22 10:32
            Start Date: 23/Jun/22 10:32
    Worklog Time Spent: 10m 
      Work Description: cfg1234 opened a new pull request, #4494:
URL: https://github.com/apache/hadoop/pull/4494

   I found that inflateReset is not called after inflate return Z_STREAM_END.When Z_STREAM_END is returned after an inflate() method is called,the next inflate() call does not consume any input data and dost not produce any output data,thus the loop cannot exit(This bug is trigged by some special compressed data).So I fix the problem. 
   
   




Issue Time Tracking
-------------------

            Worklog Id:     (was: 784120)
    Remaining Estimate: 0h
            Time Spent: 10m

> bug for GzipCodec in native task
> --------------------------------
>
>                 Key: MAPREDUCE-7392
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7392
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: nativetask
>    Affects Versions: 3.1.1
>            Reporter: chenfengge
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> perpare data command:
> yarn jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1.jar teragen -D mapreduce.job.maps=722 -D mapreduce.job.reduces=500 11000000000 /testinput
> test command:
> yarn jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.1.1.jar terasort -Dmapreduce.map.output.compress=true -Dmapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.GzipCodec -Dmapreduce.job.map.output.collector.class=org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator -D mapreduce.job.reduces=500 /testinput /testoutput
> test will blocked.
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org