You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@storm.apache.org by "Robert Joseph Evans (JIRA)" <ji...@apache.org> on 2016/09/23 17:57:21 UTC
[jira] [Closed] (STORM-2117) Supervisor V2 with local mode extracts
resources directory to topology root directory instead of temporary
directory
[ https://issues.apache.org/jira/browse/STORM-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans closed STORM-2117.
--------------------------------------
Resolution: Fixed
Fix Version/s: 2.0.0
thanks [~kabhwan],
I merged this into master and will pull it into my 1.x pull request.
> Supervisor V2 with local mode extracts resources directory to topology root directory instead of temporary directory
> --------------------------------------------------------------------------------------------------------------------
>
> Key: STORM-2117
> URL: https://issues.apache.org/jira/browse/STORM-2117
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-core
> Reporter: Jungtaek Lim
> Assignee: Jungtaek Lim
> Priority: Critical
> Fix For: 2.0.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> {code}
> 20:43:57.692 [timer] INFO o.a.s.d.nimbus - Setting new assignment for topology id storm-sql-1-1474544636: #org.apache.storm.daemon.common.Assignment{:master-code-dir "/var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T//ba7ef925-0dd5-4ddd-91ad-02ff877b99ef", :node->host {"35e30049-e731-40e7-a093-2ac22d9efa34" "192.168.0.9"}, :executor->node+port {[4 4] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [3 3] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [6 6] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [2 2] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [5 5] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024], [1 1] ["35e30049-e731-40e7-a093-2ac22d9efa34" 1024]}, :executor->start-time-secs {[1 1] 1474544637, [2 2] 1474544637, [3 3] 1474544637, [4 4] 1474544637, [5 5] 1474544637, [6 6] 1474544637}, :worker->resources {["35e30049-e731-40e7-a093-2ac22d9efa34" 1024] [0.0 0.0 0.0]}}
> 20:43:57.824 [Async Localizer] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting
> 20:43:57.825 [SLOT_1024] INFO o.a.s.d.s.Slot - STATE EMPTY msInState: 1016 -> WAITING_FOR_BASIC_LOCALIZATION msInState: 0
> 20:43:57.827 [Async Localizer] INFO o.a.s.b.FileBlobStoreImpl - Creating new blob store based in /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/ba7ef925-0dd5-4ddd-91ad-02ff877b99ef/blobs
> 20:43:57.830 [Async Localizer-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State change: CONNECTED
> 20:43:57.846 [Curator-Framework-0] INFO o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting
> 20:43:57.920 [Async Localizer] INFO o.a.s.l.AsyncLocalizer - Extracting resources from jar at /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/lib/ant-javafx.jar to /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274/resources
> 20:43:57.941 [Async Localizer] WARN o.a.s.l.AsyncLocalizer - Failed to download basic resources for topology-id storm-sql-1-1474544636
> 20:43:57.941 [Async Localizer] INFO o.a.s.d.s.AdvancedFSOps - Deleting path /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274
> 20:43:57.944 [Async Localizer] INFO o.a.s.d.s.AdvancedFSOps - Deleting path /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636
> 20:43:57.947 [Async Localizer] WARN o.a.s.l.AsyncLocalizer - Caught Exception While Downloading (rethrowing)...
> java.nio.file.FileSystemException: /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274 -> /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636: Directory not empty
> at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) ~[?:1.8.0_66]
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_66]
> at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:396) ~[?:1.8.0_66]
> at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262) ~[?:1.8.0_66]
> at java.nio.file.Files.move(Files.java:1395) ~[?:1.8.0_66]
> at org.apache.storm.daemon.supervisor.AdvancedFSOps.moveDirectoryPreferAtomic(AdvancedFSOps.java:159) ~[classes/:?]
> at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:144) [classes/:?]
> at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:98) [classes/:?]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_66]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_66]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_66]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_66]
> 20:43:57.953 [SLOT_1024] ERROR o.a.s.d.s.Slot - Error when processing event
> java.util.concurrent.ExecutionException: java.nio.file.FileSystemException: /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274 -> /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636: Directory not empty
> at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[?:1.8.0_66]
> at java.util.concurrent.FutureTask.get(FutureTask.java:206) ~[?:1.8.0_66]
> at org.apache.storm.localizer.LocalDownloadedResource$NoCancelFuture.get(LocalDownloadedResource.java:63) ~[classes/:?]
> at org.apache.storm.daemon.supervisor.Slot.handleWaitingForBasicLocalization(Slot.java:413) ~[classes/:?]
> at org.apache.storm.daemon.supervisor.Slot.stateMachineStep(Slot.java:273) ~[classes/:?]
> at org.apache.storm.daemon.supervisor.Slot.run(Slot.java:741) [classes/:?]
> Caused by: java.nio.file.FileSystemException: /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/tmp/0271204f-6007-4571-b8e7-4a7aa124f274 -> /var/folders/t7/dd7tgll1435bm2kbsdy358880000gn/T/043fbb03-fbdc-4271-bbae-923f1138745d/supervisor/stormdist/storm-sql-1-1474544636: Directory not empty
> at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) ~[?:1.8.0_66]
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_66]
> at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:396) ~[?:1.8.0_66]
> at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262) ~[?:1.8.0_66]
> at java.nio.file.Files.move(Files.java:1395) ~[?:1.8.0_66]
> at org.apache.storm.daemon.supervisor.AdvancedFSOps.moveDirectoryPreferAtomic(AdvancedFSOps.java:159) ~[classes/:?]
> at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:144) ~[classes/:?]
> at org.apache.storm.localizer.AsyncLocalizer$DownloadBaseBlobsDistributed.call(AsyncLocalizer.java:98) ~[classes/:?]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_66]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_66]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_66]
> at java.lang.Thread.run(Thread.java:745) ~[?:1.8.0_66]
> 20:43:57.954 [SLOT_1024] ERROR o.a.s.u.Utils - Halting process: Error when processing an event
> java.lang.RuntimeException: Halting process: Error when processing an event
> at org.apache.storm.utils.Utils.exitProcess(Utils.java:1771) [classes/:?]
> at org.apache.storm.daemon.supervisor.Slot.run(Slot.java:774) [classes/:?]
> Process finished with exit code 20
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)