You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2021/04/09 14:27:00 UTC
[jira] [Assigned] (TEZ-4302) NullPointerException in CodecUtils
with GzipCodec
[ https://issues.apache.org/jira/browse/TEZ-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
László Bodor reassigned TEZ-4302:
---------------------------------
Assignee: Xi Chen
> NullPointerException in CodecUtils with GzipCodec
> -------------------------------------------------
>
> Key: TEZ-4302
> URL: https://issues.apache.org/jira/browse/TEZ-4302
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.10.0
> Reporter: Xi Chen
> Assignee: Xi Chen
> Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> When bufferSizeProp is null, CodecUtils.getDecompressedInputStreamWithBufferSize runs into NullPointerException:
> {code:java}
> // code placeholder
> java.io.IOException: java.lang.NullPointerException
> at org.apache.tez.runtime.library.common.shuffle.ShuffleUtils.shuffleToMemory(ShuffleUtils.java:142)
> at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.copyMapOutput(FetcherOrderedGrouped.java:550)
> at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.copyFromHost(FetcherOrderedGrouped.java:283)
> at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.fetchNext(FetcherOrderedGrouped.java:182)
> at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.callInternal(FetcherOrderedGrouped.java:194)
> at org.apache.tez.runtime.library.common.shuffle.orderedgrouped.FetcherOrderedGrouped.callInternal(FetcherOrderedGrouped.java:57)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
> at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:69)
> at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.NullPointerException
> at java.util.Hashtable.get(Hashtable.java:363)
> at java.util.Properties.getProperty(Properties.java:969)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:1200)
> at org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1254)
> at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1479)
> at org.apache.tez.runtime.library.utils.CodecUtils.getDecompressedInputStreamWithBufferSize(CodecUtils.java:81)
> at org.apache.tez.runtime.library.common.sort.impl.IFile$Reader.readToMemory(IFile.java:824)
> at org.apache.tez.runtime.library.common.shuffle.ShuffleUtils.shuffleToMemory(ShuffleUtils.java:121)
> ... 12 more
> {code}
> Configuration.getInt(String name, int defaultValue) assumes the name is not null.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)