You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by rmetzger <gi...@git.apache.org> on 2015/04/10 17:50:32 UTC

[GitHub] flink pull request: [runtime] Avoid IllegalStateException when Tas...

GitHub user rmetzger opened a pull request:

    https://github.com/apache/flink/pull/587

    [runtime] Avoid IllegalStateException when TaskManager is killed during startup

    A YARN test was failing because a TaskManager had the following exception in its logs
    ```
    15:17:14,651 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Temporary file directory '/home/travis/build/rmetzger/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-localDir-nm-0_0/usercache/travis/appcache/application_1428678925260_0006': total 18 GB, usable 10 GB (55.56% usable)
    15:17:14,859 INFO  org.apache.flink.runtime.io.network.buffer.NetworkBufferPool  - Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
    15:17:15,150 INFO  org.apache.flink.runtime.taskmanager.TaskManager              - Using 0.7 of the currently free heap space for Flink managed memory (492 MB).
    15:17:16,114 ERROR org.apache.flink.yarn.appMaster.YarnTaskManagerRunner         - RECEIVED SIGNAL 15: SIGTERM
    15:17:16,115 INFO  org.apache.flink.runtime.io.disk.iomanager.IOManager          - I/O manager uses directory /home/travis/build/rmetzger/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-localDir-nm-0_0/usercache/travis/appcache/application_1428678925260_0006/flink-io-65c2a428-64a1-4a60-bf65-2a5f49dd965c for spill files.
    15:17:16,116 ERROR org.apache.flink.runtime.taskmanager.TaskManager              - Error while starting up taskManager
    java.lang.IllegalStateException: Shutdown in progress
    	at java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:66)
    	at java.lang.Runtime.addShutdownHook(Runtime.java:211)
    	at org.apache.flink.runtime.io.disk.iomanager.IOManager.<init>(IOManager.java:106)
    	at org.apache.flink.runtime.io.disk.iomanager.IOManagerAsync.<init>(IOManagerAsync.java:78)
    	at org.apache.flink.runtime.taskmanager.TaskManager$.startTaskManagerComponentsAndActor(TaskManager.scala:1555)
    	at org.apache.flink.runtime.taskmanager.TaskManager$.runTaskManager(TaskManager.scala:1392)
    	at org.apache.flink.runtime.taskmanager.TaskManager$.selectNetworkInterfaceAndRunTaskManager(TaskManager.scala:1265)
    	at org.apache.flink.runtime.taskmanager.TaskManager.selectNetworkInterfaceAndRunTaskManager(TaskManager.scala)
    	at org.apache.flink.yarn.appMaster.YarnTaskManagerRunner$1.run(YarnTaskManagerRunner.java:90)
    	at java.security.AccessController.doPrivileged(Native Method)
    	at javax.security.auth.Subject.doAs(Subject.java:360)
    	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
    	at org.apache.flink.yarn.appMaster.YarnTaskManagerRunner.main(YarnTaskManagerRunner.java:86)
    ```
    
    This change should avoid such errors in the future.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/rmetzger/flink iomanager_during_shutdown

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/587.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #587
    
----
commit c0a52727ccfe7e9e38e4795c62f397608b58c757
Author: Robert Metzger <rm...@apache.org>
Date:   2015-04-10T15:49:20Z

    [runtime] Avoid IllegalStateException when TaskManager is killed during startup

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] flink pull request: [runtime] Avoid IllegalStateException when Tas...

Posted by rmetzger <gi...@git.apache.org>.
Github user rmetzger commented on the pull request:

    https://github.com/apache/flink/pull/587#issuecomment-92676965
  
    I'll merge this PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] flink pull request: [runtime] Avoid IllegalStateException when Tas...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/flink/pull/587


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---