You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2016/09/22 11:45:20 UTC

[jira] [Created] (STORM-2117) Supervisor V2 with local mode extracts resources directory to topology root directory instead of temporary directory

Jungtaek Lim created STORM-2117:
-----------------------------------

             Summary: Supervisor V2 with local mode extracts resources directory to topology root directory instead of temporary directory
                 Key: STORM-2117
                 URL: https://issues.apache.org/jira/browse/STORM-2117
             Project: Apache Storm
          Issue Type: Bug
          Components: storm-core
            Reporter: Jungtaek Lim
            Assignee: Jungtaek Lim
            Priority: Critical


{code}
20:43:57.692 [timer] INFO  o.a.s.d.nimbus - Setting new assignment for topology id storm-sql-1-1474544636: #org.apache.storm.daemon.common.Assignment{:master-code-dir "/var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T//ba7ef925-0dd5-4ddd-91ad-02ff877b99ef", :node->host {"35e30049-e731-40e7-a093-2ac22d9efa34" "192.168.0.9"}, :executor->node+port {[4 4] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [3 3] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [6 6] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [2 2] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [5 5] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [1 1] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024]}, :executor->start-time-secs {[1 1] 1474544637, [2 2] 1474544637, [3 3] 1474544637, [4 4] 1474544637, [5 5] 1474544637, [6 6] 1474544637}, :worker->resources {["35e30049-e731-40e7-a093-2ac22d9efa34" 1024] [0.0 0.0 0.0]}}
20:43:57.824 [Async Localizer] INFO  o.a.c.f.i.CuratorFrameworkImpl - Starting
20:43:57.825 [SLOT_1024] INFO  o.a.s.d.s.Slot - STATE EMPTY msInState: 1016 -> WAITING_FOR_BASIC_LOCALIZATION msInState: 0
20:43:57.827 [Async Localizer] INFO  o.a.s.b.FileBlobStoreImpl - Creating new blob store based in /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/ba7ef925-0dd5-4ddd-91ad-02ff877b99ef/blobs
20:43:57.830 [Async Localizer-EventThread] INFO  o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
20:43:57.846 [Curator-Framework-0] INFO  o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
20:43:57.920 [Async Localizer] INFO  o.a.s.l.AsyncLocalizer - Extracting resources from jar at /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/lib/ant-javafx.jar to /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274/resources
20:43:57.941 [Async Localizer] WARN  o.a.s.l.AsyncLocalizer - Failed to download basic resources for topology-id storm-sql-1-1474544636
20:43:57.941 [Async Localizer] INFO  o.a.s.d.s.AdvancedFSOps - Deleting path /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274
20:43:57.944 [Async Localizer] INFO  o.a.s.d.s.AdvancedFSOps - Deleting path /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636
20:43:57.947 [Async Localizer] WARN  o.a.s.l.AsyncLocalizer - Caught Exception While Downloading (rethrowing)... 
java.nio.file.FileSystemException: /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274 -> /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636: Directory not empty
	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) ~[?:1.8.0_66]
	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_66]
	at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:396) ~[?:1.8.0_66]
	at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262) ~[?:1.8.0_66]
	at java.nio.file.Files.move(Files.java:1395) ~[?:1.8.0_66]
	at org.apache.storm.daemon.supervisor.AdvancedFSOps.moveDirectoryPreferAtomic(AdvancedFSOps.java:159) ~[classes/:?]
	at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:144) [classes/:?]
	at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:98) [classes/:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_66]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_66]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_66]
	at java.lang.Thread.run(Thread.java:745) [?:1.8.0_66]
20:43:57.953 [SLOT_1024] ERROR o.a.s.d.s.Slot - Error when processing event
java.util.concurrent.ExecutionException: java.nio.file.FileSystemException: /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274 -> /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636: Directory not empty
	at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[?:1.8.0_66]
	at java.util.concurrent.FutureTask.get(FutureTask.java:206) ~[?:1.8.0_66]
	at org.apache.storm.localizer.LocalDownloadedResource$NoCancelFuture.get(LocalDownloadedResource.java:63) ~[classes/:?]
	at org.apache.storm.daemon.supervisor.Slot.handleWaitingForBasicLocalization(Slot.java:413) ~[classes/:?]
	at org.apache.storm.daemon.supervisor.Slot.stateMachineStep(Slot.java:273) ~[classes/:?]
	at org.apache.storm.daemon.supervisor.Slot.run(Slot.java:741) [classes/:?]
Caused by: java.nio.file.FileSystemException: /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274 -> /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636: Directory not empty
	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) ~[?:1.8.0_66]
	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_66]
	at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:396) ~[?:1.8.0_66]
	at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262) ~[?:1.8.0_66]
	at java.nio.file.Files.move(Files.java:1395) ~[?:1.8.0_66]
	at org.apache.storm.daemon.supervisor.AdvancedFSOps.moveDirectoryPreferAtomic(AdvancedFSOps.java:159) ~[classes/:?]
	at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:144) ~[classes/:?]
	at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:98) ~[classes/:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_66]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_66]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_66]
	at java.lang.Thread.run(Thread.java:745) ~[?:1.8.0_66]
20:43:57.954 [SLOT_1024] ERROR o.a.s.u.Utils - Halting process: Error when processing an event
java.lang.RuntimeException: Halting process: Error when processing an event
	at org.apache.storm.utils.Utils.exitProcess(Utils.java:1771) [classes/:?]
	at org.apache.storm.daemon.supervisor.Slot.run(Slot.java:774) [classes/:?]

Process finished with exit code 20
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)