You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Dawid Wysakowicz (Jira)" <ji...@apache.org> on 2021/10/21 15:40:00 UTC
[jira] [Closed] (FLINK-24468) NPE when notifyNewBufferSize
[ https://issues.apache.org/jira/browse/FLINK-24468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dawid Wysakowicz closed FLINK-24468.
------------------------------------
Fix Version/s: 1.14.1
1.15.0
Resolution: Fixed
Fixed in:
* master
** 4648e8af115410b4d1a5aefed44cdb6bd9d07ebb..60f39ed62b4d64f34c5d709253265add2831e662
* 1.14.1
** de8484691f1422dffd38853d13d2b79c0c4b2a6d..9ed6ad8c904d8bda6287ed4b8bac83323ce52f0e
> NPE when notifyNewBufferSize
> ----------------------------
>
> Key: FLINK-24468
> URL: https://issues.apache.org/jira/browse/FLINK-24468
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
> Affects Versions: 1.14.0
> Reporter: Anton Kalashnikov
> Assignee: Anton Kalashnikov
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.15.0, 1.14.1
>
>
> In my opinion, we have two problem there:
> # The exception itself(see below)
> # Ignoring the exception and stopping rescheduling of the calculation of the buffer size.
> Of course, we need to fix this NPE and we need to think what we want to do if the buffer debloat fails with error.
> {noformat}
> java.lang.NullPointerException: null
> at org.apache.flink.runtime.io.network.netty.CreditBasedPartitionRequestClientHandler.notifyNewBufferSize(CreditBasedPartitionRequestClientHandler.java:135) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.runtime.io.network.netty.NettyPartitionRequestClient.notifyNewBufferSize(NettyPartitionRequestClient.java:203) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.notifyNewBufferSize(RemoteInputChannel.java:330) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.announceBufferSize(RemoteInputChannel.java:299) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.announceBufferSize(SingleInputGate.java:389) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.runtime.taskmanager.InputGateWithMetrics.announceBufferSize(InputGateWithMetrics.java:102) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.streaming.runtime.tasks.bufferdebloat.BufferDebloater.recalculateBufferSize(BufferDebloater.java:118) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.streaming.runtime.tasks.StreamTask.debloat(StreamTask.java:795) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$null$4(StreamTask.java:784) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.util.function.FunctionUtils.lambda$asCallable$5(FunctionUtils.java:126) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_282]
> at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.streaming.runtime.tasks.mailbox.Mail.run(Mail.java:90) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMailsNonBlocking(MailboxProcessor.java:353) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMail(MailboxProcessor.java:317) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:201) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:814) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:761) ~[flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:958) [flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:937) [flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:754) [flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:575) [flink-dist_2.12-1.15-SNAPSHOT.jar:1.15-SNAPSHOT]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_282]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)