You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by GitBox <gi...@apache.org> on 2021/06/09 05:34:48 UTC

[GitHub] [tez] abstractdog commented on pull request #130: TEZ-4295: Could not decompress data. Buffer length is too small.

abstractdog commented on pull request #130:
URL: https://github.com/apache/tez/pull/130#issuecomment-857390120


   > Hi,
   > Why do not report the IFile fix part of the patch in the Jira ? https://issues.apache.org/jira/secure/attachment/13020838/TEZ-4295.01.patch
   > I just test your patch in my prod env and i still have the issue.
   > If i add the part inside IFile it's fixing the issue.
   > 
   > Regards
   
   Thanks @tprelle for letting us know! It's very strange, I haven't been able to reproduce by unit test, that's why went only for fixing CodecUtils.getDecompressedInputStreamWithBufferSize. Let me think about this again before committing the fix. Could you share some details about your workload: what exception trace did you get (the same as reported in jira)? What's your upstream application, hive, or something else?
   
   I'm 100% about including the fix for every compressor/decompressor instantiation (so including changes in IFile you mentioned), I just want to cover it by a unit test in order to prevent regressions in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org