You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@brooklyn.apache.org by "Aled Sage (JIRA)" <ji...@apache.org> on 2016/07/23 10:34:20 UTC
[jira] [Created] (BROOKLYN-317) AWS-EC2 provisioning fails: doesn't
get public ip when waiting for ssh-reachability
Aled Sage created BROOKLYN-317:
----------------------------------
Summary: AWS-EC2 provisioning fails: doesn't get public ip when waiting for ssh-reachability
Key: BROOKLYN-317
URL: https://issues.apache.org/jira/browse/BROOKLYN-317
Project: Brooklyn
Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Aled Sage
When using Brooklyn 0.10.0-SNAPSHOT...
When deploying an app in aws-ec2 singapore, one of the VMs failed to provision (failed to reach port 22).
The workaround is to configure {{machineCreateAttempts}} on the location, setting it to a number greater than 1. It will thus retry if the problem is encountered.
Looking at the node information, it only lists the private address (and the private hostname), and not the public ip.
Looking in the jclouds wire log, the first result from the API call {{Action=DescribeInstances&InstanceId.1=i-20c2df84&Version=2012-06-01}} only had the private address and not the public address.
In terms of timing, we first started polling for the instance details at 10:58:38,293, and stopped polling at 10:58:56,764 (when the VM was "running"). At that point, the API responses still did not have the public address. We then waiting for an ssh port to be reachable, which timed out. We began to destroy the VM at 11:09:00,292 - the api result then included the public IP.
I suspect that this will need to be fixed in jclouds: we'll need to poll again for the instance details, rather than just waiting for one of the initial private/public addresses to be reachable.
{noformat}
Failed after 11m 12s: Error invoking start at VanillaSoftwareProcessImpl{id=mf8o2c7ef4}: RunNodesException: error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1) image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo, brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a, parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o, imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true}, status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)}, loginUser=centos}
at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException: Error invoking start at VanillaSoftwareProcessImpl{id=mf8o2c7ef4}: RunNodesException: error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1) image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo, brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a, parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o, imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true}, status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)}, loginUser=centos}
at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException.propagate(EffectorUtils.java:318)
at org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException.access$100(EffectorUtils.java:285)
at org.apache.brooklyn.core.mgmt.internal.EffectorUtils.handleEffectorException(EffectorUtils.java:326)
at org.apache.brooklyn.core.effector.EffectorTasks$EffectorBodyTaskFactory$2.handleException(EffectorTasks.java:90)
at org.apache.brooklyn.util.core.task.DynamicSequentialTask.handleException(DynamicSequentialTask.java:469)
at org.apache.brooklyn.util.core.task.DynamicSequentialTask$DstJob.call(DynamicSequentialTask.java:417)
at org.apache.brooklyn.util.core.task.BasicExecutionManager$SubmissionCallable.call(BasicExecutionManager.java:519)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException: RunNodesException: error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1) image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo, brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a, parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o, imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true}, status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)}, loginUser=centos}
at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at org.apache.brooklyn.util.exceptions.Exceptions.propagate(Exceptions.java:129)
at org.apache.brooklyn.util.core.task.BasicTask.getUnchecked(BasicTask.java:372)
at org.apache.brooklyn.util.core.task.Tasks$2.get(Tasks.java:293)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.preStartAtMachineAsync(MachineLifecycleEffectorTasks.java:465)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.startInLocation(MachineLifecycleEffectorTasks.java:382)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.startInLocations(MachineLifecycleEffectorTasks.java:367)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.start(MachineLifecycleEffectorTasks.java:356)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$StartEffectorBody.call(MachineLifecycleEffectorTasks.java:257)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$StartEffectorBody.call(MachineLifecycleEffectorTasks.java:244)
at org.apache.brooklyn.core.effector.EffectorTasks$EffectorBodyTaskFactory$1.call(EffectorTasks.java:82)
at org.apache.brooklyn.util.core.task.DynamicSequentialTask$DstJob.call(DynamicSequentialTask.java:359)
... 5 more
Caused by: java.util.concurrent.ExecutionException: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException: RunNodesException: error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1) image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo, brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a, parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o, imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true}, status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)}, loginUser=centos}
at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:188)
at com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:63)
at org.apache.brooklyn.util.core.task.BasicTask.get(BasicTask.java:361)
at org.apache.brooklyn.util.core.task.BasicTask.getUnchecked(BasicTask.java:370)
... 14 more
Caused by: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException: RunNodesException: error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1) image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo, brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a, parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o, imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true}, status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)}, loginUser=centos}
at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at org.apache.brooklyn.util.exceptions.Exceptions.propagate(Exceptions.java:129)
at org.apache.brooklyn.location.jclouds.JcloudsLocation.obtainOnce(JcloudsLocation.java:1103)
at org.apache.brooklyn.location.jclouds.JcloudsLocation.obtain(JcloudsLocation.java:626)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ObtainLocationTask.call(MachineLifecycleEffectorTasks.java:459)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ObtainLocationTask.call(MachineLifecycleEffectorTasks.java:449)
at org.apache.brooklyn.util.core.task.Tasks.withBlockingDetails(Tasks.java:106)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ProvisionMachineTask.call(MachineLifecycleEffectorTasks.java:431)
at org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ProvisionMachineTask.call(MachineLifecycleEffectorTasks.java:407)
... 6 more
Caused by: org.jclouds.compute.RunNodesException: error running 1 node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o) location(ap-southeast-1) image(ami-f068a193) size(m3.large) options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true, userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo, brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4, brooklyn-entity-name=swarm-manager, brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all], userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22 on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84, location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a, parent=ap-southeast-1, iso3166Codes=[SG]}, group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o, imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm, version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true}, status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229, privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large, processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL, size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen, supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)}, loginUser=centos}
at org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:222)
at org.jclouds.ec2.compute.EC2ComputeService.createNodesInGroup(EC2ComputeService.java:149)
at org.apache.brooklyn.location.jclouds.JcloudsLocation.obtainOnce(JcloudsLocation.java:735)
... 12 more
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)