You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Till Rohrmann (Jira)" <ji...@apache.org> on 2020/05/06 07:25:00 UTC

[jira] [Resolved] (FLINK-17514) TaskCancelerWatchdog does not kill TaskManager

     [ https://issues.apache.org/jira/browse/FLINK-17514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Till Rohrmann resolved FLINK-17514.
-----------------------------------
    Resolution: Fixed

Fixed via

1.11.0: 
0ea539d837c43541110f327a10ec207a259a32ed
221bbf792e60de7cc6197612cd3fa3621893961a
fdd128af3be23ad5b21055f3fee69602bf7712b5

1.10.1:
bd76b42228bde4f25969d65712f7799771fb91e9
f3f1bd3020c473d65fe8963262b8962d20e84d6d
48ae089e15e9a324897869e9cf2577587aceffbf

> TaskCancelerWatchdog does not kill TaskManager
> ----------------------------------------------
>
>                 Key: FLINK-17514
>                 URL: https://issues.apache.org/jira/browse/FLINK-17514
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Task
>    Affects Versions: 1.10.1, 1.11.0
>            Reporter: Aljoscha Krettek
>            Assignee: Till Rohrmann
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 1.10.1, 1.11.0
>
>
> The watchdog reports a fatal error using {{taskManager.notifyFatalError(msg, null)}}. This should normally lead to the TaskManager being terminated. The code introduced in FLINK-16225
>  tries to look at the passed exception and will eventually fail with a {{NullPointerException}}, which prevents the TaskManager from being terminated.
> Stacktrace:
> {code:java}
> 2020-05-05 09:43:01,588 ERROR org.apache.flink.runtime.taskmanager.Task                     - Task did not exit gracefully within 180 + seconds.
> 2020-05-05 09:43:01,588 ERROR org.apache.flink.runtime.taskexecutor.TaskExecutor            - Task did not exit gracefully within 180 + seconds.
> 2020-05-05 09:43:01,588 ERROR org.apache.flink.runtime.taskmanager.Task                     - Error in Task Cancellation Watch Dog
> java.lang.NullPointerException
> 	at org.apache.flink.util.ExceptionUtils.isOutOfMemoryErrorWithMessageStartingWith(ExceptionUtils.java:186)
> 	at org.apache.flink.util.ExceptionUtils.isMetaspaceOutOfMemoryError(ExceptionUtils.java:170)
> 	at org.apache.flink.util.ExceptionUtils.enrichTaskManagerOutOfMemoryError(ExceptionUtils.java:144)
> 	at org.apache.flink.runtime.taskexecutor.TaskManagerRunner.onFatalError(TaskManagerRunner.java:249)
> 	at org.apache.flink.runtime.taskexecutor.TaskExecutor$TaskManagerActionsImpl.notifyFatalError(TaskExecutor.java:1751)
> 	at org.apache.flink.runtime.taskmanager.Task$TaskCancelerWatchDog.run(Task.java:1514)
> 	at java.lang.Thread.run(Thread.java:748)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)