You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by yidan zhao <hi...@gmail.com> on 2022/01/13 05:34:08 UTC

问题原因分析(task stuck for 180 seconds)

如题,具体case分析,当前有个相对频繁的是source task。如下:

2022-01-12 15:44:41,933 WARN  org.apache.flink.runtime.taskmanager.Task
               [] - Task 'Source: Dr1_Kafka(startTs:latest) -> KafkaToDr1
-> Dr1_T
imeAheadDropProcessor(30s) -> Dr1_WatermarkReAssigner(-60s) (9/40)#0' did
not react to cancelling signal - notifying TM; it is stuck for 180 seconds
in method
:
 org.apache.kafka.common.metrics.JmxReporter.metricRemoval(JmxReporter.java:91)
org.apache.kafka.common.metrics.Metrics.removeMetric(Metrics.java:534)
org.apache.kafka.common.metrics.Metrics.removeSensor(Metrics.java:448)
org.apache.kafka.common.network.Selector$SelectorMetrics.close(Selector.java:1204)
org.apache.kafka.common.network.Selector.close(Selector.java:368)
org.apache.kafka.clients.NetworkClient.close(NetworkClient.java:627)
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.close(ConsumerNetworkClient.java:505)
org.apache.kafka.clients.ClientUtils.closeQuietly(ClientUtils.java:97)
org.apache.kafka.clients.consumer.KafkaConsumer.close(KafkaConsumer.java:2177)
org.apache.kafka.clients.consumer.KafkaConsumer.close(KafkaConsumer.java:2137)
org.apache.kafka.clients.consumer.KafkaConsumer.close(KafkaConsumer.java:2088)
org.apache.flink.streaming.connectors.kafka.internals.KafkaPartitionDiscoverer.closeConnections(KafkaPartitionDiscoverer.java:108)
org.apache.flink.streaming.connectors.kafka.internals.AbstractPartitionDiscoverer.close(AbstractPartitionDiscoverer.java:104)
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.close(FlinkKafkaConsumerBase.java:924)
org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.dispose(AbstractUdfStreamOperator.java:117)
org.apache.flink.streaming.runtime.tasks.StreamTask.disposeAllOperators(StreamTask.java:861)
org.apache.flink.streaming.runtime.tasks.StreamTask$$Lambda$2372/1435656909.run(Unknown
Source)
org.apache.flink.streaming.runtime.tasks.StreamTask.runAndSuppressThrowable(StreamTask.java:840)
org.apache.flink.streaming.runtime.tasks.StreamTask.cleanUpInvoke(StreamTask.java:753)
org.apache.flink.streaming.runtime.tasks.SourceStreamTask.cleanUpInvoke(SourceStreamTask.java:186)
org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:659)
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:620)
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
java.lang.Thread.run(Thread.java:748)