You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by meng han <me...@ufl.edu> on 2013/09/26 17:32:16 UTC
Review Request 14347: Meng's GSoC 2013 final patch
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14347/
-----------------------------------------------------------
Review request for cloudstack, whirr and Sebastien Goasguen.
Repository: cloudstack-git
Description
-------
I added two APIs : launchCluster and destroyCluster
There is only one argument "config" associated with each API. For example, in CloudMonkey the following command "launchCluster config=myhadoop.properties" will start a cluster on CloudStack according to the specification in myhadoop.properties. The cluster specification file is the same file that you use when you launch a cluster using Whirr.
Below is the log of CloudMonkey when calling the launchCluster API.
2013-09-26 10:10:41,743 - requester.py:44 - [DEBUG] ======== START Request ========
2013-09-26 10:10:41,743 - requester.py:44 - [DEBUG] Requesting command=launchCluster, args={'config': '/home/meng/whirr/dream'}
2013-09-26 10:10:41,743 - requester.py:44 - [DEBUG] Request sent: http://localhost:8080/client/api?apiKey=h3DKHC9AVlhKnUhpyThMuLhC119QfNQQ8xhyjbf_rnu5ZL1QeOWdw7aZRGXVO1VApG6q0aK-A-tQRQsZFwnOXQ&command=launchCluster&config=%2Fhome%2Fmeng%2Fwhirr%2Fdream&response=json&signature=iUq8%2BTehZPmdx0Bm28lhgMf4pkg%3D
2013-09-26 10:11:32,056 - requester.py:44 - [DEBUG] Response received: { "launchclusterresponse" : { "launchCluster" : {"isasync":false,"output":"Running on provider cloudstack using identity h3DKHC9AVlhKnUhpyThMuLhC119QfNQQ8xhyjbf_rnu5ZL1QeOWdw7aZRGXVO1VApG6q0aK-A-tQRQsZFwnOXQ\n"} } }
2013-09-26 10:11:32,056 - requester.py:44 - [DEBUG] ======== END Request ========
Diffs
-----
client/pom.xml 012e466
client/tomcatconf/applicationContext.xml.in d8d21ad
client/tomcatconf/commands.properties.in a7b2f8b
plugins/api/emr/dependencies.txt PRE-CREATION
plugins/api/emr/pom.xml PRE-CREATION
plugins/api/emr/src/org/apache/cloudstack/api/command/user/emr/DestroyClusterCmd.java PRE-CREATION
plugins/api/emr/src/org/apache/cloudstack/api/command/user/emr/LaunchClusterCmd.java PRE-CREATION
plugins/api/emr/src/org/apache/cloudstack/api/response/DestroyClusterResponse.java PRE-CREATION
plugins/api/emr/src/org/apache/cloudstack/api/response/LaunchClusterResponse.java PRE-CREATION
plugins/api/emr/src/org/apache/cloudstack/emr/ElasticMapReduce.java PRE-CREATION
plugins/api/emr/src/org/apache/cloudstack/emr/ElasticMapReduceImpl.java PRE-CREATION
plugins/pom.xml 82839b9
Diff: https://reviews.apache.org/r/14347/diff/
Testing
-------
There is a conflicting dependency issue. Whirr 0.8.2 requires gson 2.2.2 while CloudStack API requires gson 1.7.1. I modified CloudStack pom file to use gson 2.2.2. When compiling CloudStack the following error popped out:
java.lang.ClassCastException: com.google.gson.internal.$Gson$Types$GenericArrayTypeImpl cannot be cast to java.lang.Class
at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:84)
at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:37)
at com.google.gson.TreeTypeAdapter.read(TreeTypeAdapter.java:58)
at com.google.gson.Gson.fromJson(Gson.java:795)
at com.cloud.agent.transport.Request.getCommands(Request.java:235)
at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1221)
at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1374)
at com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:659)
at com.cloud.utils.nio.Task.run(Task.java:83)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
WARN [utils.nio.Task] (AgentManager-Handler-2:) Caught the following exception but pushing on
java.lang.ClassCastException: com.google.gson.internal.$Gson$Types$GenericArrayTypeImpl cannot be cast to java.lang.Class
at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:84)
at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:37)
at com.google.gson.TreeTypeAdapter.read(TreeTypeAdapter.java:58)
at com.google.gson.Gson.fromJson(Gson.java:795)
at com.cloud.agent.transport.Request.getCommands(Request.java:235)
at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1221)
at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1374)
at com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:659)
at com.cloud.utils.nio.Task.run(Task.java:83)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
The following is the output on the CloudStack management server (with gson 2.2.2) when issue an api launchCluster .
Running on provider cloudstack using identity h3DKHC9AVlhKnUhpyThMuLhC119QfNQQ8xhyjbf_rnu5ZL1QeOWdw7aZRGXVO1VApG6q0aK-A-tQRQsZFwnOXQ
INFO [whirr.actions.BootstrapClusterAction] (729061754@qtp-385354117-0:) Bootstrapping cluster
INFO [whirr.compute.BootstrapTemplate] (729061754@qtp-385354117-0:) Configuring template for bootstrap-hadoop-datanode_hadoop-tasktracker
INFO [whirr.compute.BootstrapTemplate] (729061754@qtp-385354117-0:) Configuring template for bootstrap-hadoop-namenode_hadoop-jobtracker
INFO [whirr.compute.NodeStarter] (pool-4-thread-2:) Starting 1 node(s) with roles [hadoop-datanode, hadoop-tasktracker]
INFO [whirr.compute.NodeStarter] (pool-4-thread-4:) Starting 1 node(s) with roles [hadoop-namenode, hadoop-jobtracker]
INFO [cloud.api.ApiServer] (2033387022@qtp-385354117-4:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
INFO [cloud.api.ApiServer] (2033387022@qtp-385354117-4:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
ERROR [jclouds.compute] (user thread 3:) createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2363ms/op
java.util.concurrent.ExecutionException: java.lang.IllegalStateException: { "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:306)
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:293)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
at org.jclouds.concurrent.FutureIterables$1.run(FutureIterables.java:138)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.IllegalStateException: { "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }
at org.jclouds.cloudstack.handlers.CloudStackErrorHandler.handleError(CloudStackErrorHandler.java:78)
at org.jclouds.http.handlers.DelegatingErrorHandler.handleError(DelegatingErrorHandler.java:69)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.shouldContinue(BaseHttpCommandExecutorService.java:197)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.call(BaseHttpCommandExecutorService.java:167)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.call(BaseHttpCommandExecutorService.java:135)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.http.internal.BaseHttpCommandExecutorService.submit(BaseHttpCommandExecutorService.java:132)
at org.jclouds.http.TransformingHttpCommandExecutorServiceImpl.submit(TransformingHttpCommandExecutorServiceImpl.java:54)
at org.jclouds.http.TransformingHttpCommandImpl.execute(TransformingHttpCommandImpl.java:73)
at org.jclouds.rest.internal.AsyncRestClientProxy.createListenableFutureForHttpRequestMappedToMethodAndArgs(AsyncRestClientProxy.java:254)
at org.jclouds.rest.internal.AsyncRestClientProxy.invoke(AsyncRestClientProxy.java:148)
at $Proxy142.getAsyncJob(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.jclouds.concurrent.internal.SyncProxy.invoke(SyncProxy.java:170)
at $Proxy143.getAsyncJob(Unknown Source)
at org.jclouds.cloudstack.strategy.BlockUntilJobCompletesAndReturnResult.apply(BlockUntilJobCompletesAndReturnResult.java:68)
at org.jclouds.cloudstack.compute.strategy.CloudStackComputeServiceAdapter.createNodeWithGroupEncodedIntoName(CloudStackComputeServiceAdapter.java:183)
at org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.createNodeWithGroupEncodedIntoName(AdaptingComputeServiceStrategies.java:186)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:82)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:66)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.http.internal.BaseHttpCommandExecutorService.submit(BaseHttpCommandExecutorService.java:132)
at org.jclouds.http.TransformingHttpCommandExecutorServiceImpl.submit(TransformingHttpCommandExecutorServiceImpl.java:54)
at org.jclouds.http.TransformingHttpCommandImpl.execute(TransformingHttpCommandImpl.java:73)
at org.jclouds.rest.internal.AsyncRestClientProxy.createListenableFutureForHttpRequestMappedToMethodAndArgs(AsyncRestClientProxy.java:254)
at org.jclouds.rest.internal.AsyncRestClientProxy.invoke(AsyncRestClientProxy.java:148)
at $Proxy142.getAsyncJob(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.jclouds.concurrent.internal.SyncProxy.invoke(SyncProxy.java:170)
at $Proxy143.getAsyncJob(Unknown Source)
at org.jclouds.cloudstack.strategy.BlockUntilJobCompletesAndReturnResult.apply(BlockUntilJobCompletesAndReturnResult.java:68)
at org.jclouds.cloudstack.compute.strategy.CloudStackComputeServiceAdapter.createNodeWithGroupEncodedIntoName(CloudStackComputeServiceAdapter.java:183)
at org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.createNodeWithGroupEncodedIntoName(AdaptingComputeServiceStrategies.java:186)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:82)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:66)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.createNodeInGroupWithNameAndTemplate(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:170)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.execute(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:125)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:215)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.createNodeInGroupWithNameAndTemplate(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:170)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.execute(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:125)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:215)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
... 6 more
Caused by: org.jclouds.http.HttpResponseException: command: GET http://localhost:8080/client/api?response=json&command=queryAsyncJobResult&jobid=a840d58f-4394-40b1-aec5-ecae51658f03 HTTP/1.1 failed with response: HTTP/1.1 431 431; content: [{ "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }]
... 77 more
ERROR [jclouds.compute] (pool-4-thread-2:) createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2367ms/op
java.lang.RuntimeException: createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2367ms/op
at org.jclouds.concurrent.FutureIterables.awaitCompletion(FutureIterables.java:168)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:219)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
INFO [whirr.compute.NodeStarter] (pool-4-thread-2:) Starting 1 node(s) with roles [hadoop-datanode, hadoop-tasktracker]
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
ERROR [jclouds.compute] (user thread 2:) createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2516ms/op
java.util.concurrent.ExecutionException: java.lang.IllegalStateException: { "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:306)
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:293)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
at org.jclouds.concurrent.FutureIterables$1.run(FutureIterables.java:138)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.IllegalStateException: { "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }
at org.jclouds.cloudstack.handlers.CloudStackErrorHandler.handleError(CloudStackErrorHandler.java:78)
at org.jclouds.http.handlers.DelegatingErrorHandler.handleError(DelegatingErrorHandler.java:69)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.shouldContinue(BaseHttpCommandExecutorService.java:197)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.call(BaseHttpCommandExecutorService.java:167)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.call(BaseHttpCommandExecutorService.java:135)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.http.internal.BaseHttpCommandExecutorService.submit(BaseHttpCommandExecutorService.java:132)
at org.jclouds.http.TransformingHttpCommandExecutorServiceImpl.submit(TransformingHttpCommandExecutorServiceImpl.java:54)
at org.jclouds.http.TransformingHttpCommandImpl.execute(TransformingHttpCommandImpl.java:73)
at org.jclouds.rest.internal.AsyncRestClientProxy.createListenableFutureForHttpRequestMappedToMethodAndArgs(AsyncRestClientProxy.java:254)
at org.jclouds.rest.internal.AsyncRestClientProxy.invoke(AsyncRestClientProxy.java:148)
at $Proxy142.getAsyncJob(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.jclouds.concurrent.internal.SyncProxy.invoke(SyncProxy.java:170)
at $Proxy143.getAsyncJob(Unknown Source)
at org.jclouds.cloudstack.strategy.BlockUntilJobCompletesAndReturnResult.apply(BlockUntilJobCompletesAndReturnResult.java:68)
at org.jclouds.cloudstack.compute.strategy.CloudStackComputeServiceAdapter.createNodeWithGroupEncodedIntoName(CloudStackComputeServiceAdapter.java:183)
at org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.createNodeWithGroupEncodedIntoName(AdaptingComputeServiceStrategies.java:186)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:82)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:66)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.http.internal.BaseHttpCommandExecutorService.submit(BaseHttpCommandExecutorService.java:132)
at org.jclouds.http.TransformingHttpCommandExecutorServiceImpl.submit(TransformingHttpCommandExecutorServiceImpl.java:54)
at org.jclouds.http.TransformingHttpCommandImpl.execute(TransformingHttpCommandImpl.java:73)
at org.jclouds.rest.internal.AsyncRestClientProxy.createListenableFutureForHttpRequestMappedToMethodAndArgs(AsyncRestClientProxy.java:254)
at org.jclouds.rest.internal.AsyncRestClientProxy.invoke(AsyncRestClientProxy.java:148)
at $Proxy142.getAsyncJob(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.jclouds.concurrent.internal.SyncProxy.invoke(SyncProxy.java:170)
at $Proxy143.getAsyncJob(Unknown Source)
at org.jclouds.cloudstack.strategy.BlockUntilJobCompletesAndReturnResult.apply(BlockUntilJobCompletesAndReturnResult.java:68)
at org.jclouds.cloudstack.compute.strategy.CloudStackComputeServiceAdapter.createNodeWithGroupEncodedIntoName(CloudStackComputeServiceAdapter.java:183)
at org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.createNodeWithGroupEncodedIntoName(AdaptingComputeServiceStrategies.java:186)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:82)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:66)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.createNodeInGroupWithNameAndTemplate(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:170)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.execute(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:125)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:215)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.createNodeInGroupWithNameAndTemplate(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:170)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.execute(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:125)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:215)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
... 6 more
Caused by: org.jclouds.http.HttpResponseException: command: GET http://localhost:8080/client/api?response=json&command=queryAsyncJobResult&jobid=6884378d-4aa8-4e16-970a-d7b02068eac1 HTTP/1.1 failed with response: HTTP/1.1 431 431; content: [{ "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }]
... 77 more
ERROR [jclouds.compute] (pool-4-thread-4:) createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2519ms/op
java.lang.RuntimeException: createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2519ms/op
at org.jclouds.concurrent.FutureIterables.awaitCompletion(FutureIterables.java:168)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:219)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
INFO [whirr.compute.NodeStarter] (pool-4-thread-4:) Starting 1 node(s) with roles [hadoop-namenode, hadoop-jobtracker]
INFO [user.vm.DeployVMCmd] (Job-Executor-1:job-124) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|hadoop-ed3]Scope=interface com.cloud.dc.DataCenter; id=1
INFO [user.vm.DeployVMCmd] (Job-Executor-1:job-124) Unable to create a deployment for VM[User|hadoop-ed3]
com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|hadoop-ed3]Scope=interface com.cloud.dc.DataCenter; id=1
at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:186)
at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:198)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3464)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3450)
at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:379)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
INFO [cloud.api.ApiServer] (2033387022@qtp-385354117-4:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
INFO [cloud.api.ApiServer] (2033387022@qtp-385354117-4:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
ERROR [jclouds.compute] (user thread 3:) createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2001ms/op
java.util.concurrent.ExecutionException: java.lang.IllegalStateException: { "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:306)
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:293)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
at org.jclouds.concurrent.FutureIterables$1.run(FutureIterables.java:138)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.IllegalStateException: { "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }
at org.jclouds.cloudstack.handlers.CloudStackErrorHandler.handleError(CloudStackErrorHandler.java:78)
at org.jclouds.http.handlers.DelegatingErrorHandler.handleError(DelegatingErrorHandler.java:69)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.shouldContinue(BaseHttpCommandExecutorService.java:197)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.call(BaseHttpCommandExecutorService.java:167)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.call(BaseHttpCommandExecutorService.java:135)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.http.internal.BaseHttpCommandExecutorService.submit(BaseHttpCommandExecutorService.java:132)
at org.jclouds.http.TransformingHttpCommandExecutorServiceImpl.submit(TransformingHttpCommandExecutorServiceImpl.java:54)
at org.jclouds.http.TransformingHttpCommandImpl.execute(TransformingHttpCommandImpl.java:73)
at org.jclouds.rest.internal.AsyncRestClientProxy.createListenableFutureForHttpRequestMappedToMethodAndArgs(AsyncRestClientProxy.java:254)
at org.jclouds.rest.internal.AsyncRestClientProxy.invoke(AsyncRestClientProxy.java:148)
at $Proxy142.getAsyncJob(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.jclouds.concurrent.internal.SyncProxy.invoke(SyncProxy.java:170)
at $Proxy143.getAsyncJob(Unknown Source)
at org.jclouds.cloudstack.strategy.BlockUntilJobCompletesAndReturnResult.apply(BlockUntilJobCompletesAndReturnResult.java:68)
at org.jclouds.cloudstack.compute.strategy.CloudStackComputeServiceAdapter.createNodeWithGroupEncodedIntoName(CloudStackComputeServiceAdapter.java:183)
at org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.createNodeWithGroupEncodedIntoName(AdaptingComputeServiceStrategies.java:186)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:82)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:66)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.http.internal.BaseHttpCommandExecutorService.submit(BaseHttpCommandExecutorService.java:132)
at org.jclouds.http.TransformingHttpCommandExecutorServiceImpl.submit(TransformingHttpCommandExecutorServiceImpl.java:54)
at org.jclouds.http.TransformingHttpCommandImpl.execute(TransformingHttpCommandImpl.java:73)
at org.jclouds.rest.internal.AsyncRestClientProxy.createListenableFutureForHttpRequestMappedToMethodAndArgs(AsyncRestClientProxy.java:254)
at org.jclouds.rest.internal.AsyncRestClientProxy.invoke(AsyncRestClientProxy.java:148)
at $Proxy142.getAsyncJob(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.jclouds.concurrent.internal.SyncProxy.invoke(SyncProxy.java:170)
at $Proxy143.getAsyncJob(Unknown Source)
at org.jclouds.cloudstack.strategy.BlockUntilJobCompletesAndReturnResult.apply(BlockUntilJobCompletesAndReturnResult.java:68)
at org.jclouds.cloudstack.compute.strategy.CloudStackComputeServiceAdapter.createNodeWithGroupEncodedIntoName(CloudStackComputeServiceAdapter.java:183)
at org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.createNodeWithGroupEncodedIntoName(AdaptingComputeServiceStrategies.java:186)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:82)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:66)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.createNodeInGroupWithNameAndTemplate(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:170)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.execute(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:125)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:215)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.createNodeInGroupWithNameAndTemplate(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:170)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.execute(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:125)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:215)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
... 6 more
Caused by: org.jclouds.http.HttpResponseException: command: GET http://localhost:8080/client/api?response=json&command=queryAsyncJobResult&jobid=d5c55d23-e7de-4e04-a2e5-5121f6101558 HTTP/1.1 failed with response: HTTP/1.1 431 431; content: [{ "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }]
... 77 more
ERROR [jclouds.compute] (pool-4-thread-2:) createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2004ms/op
java.lang.RuntimeException: createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2004ms/op
at org.jclouds.concurrent.FutureIterables.awaitCompletion(FutureIterables.java:168)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:219)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
ERROR [apache.whirr.ClusterController] (729061754@qtp-385354117-0:) Unable to start the cluster. Terminating all nodes.
java.io.IOException: java.util.concurrent.ExecutionException: java.io.IOException: Too many instance failed while bootstrapping! 0 successfully started instances while 0 instances failed
at org.apache.whirr.actions.BootstrapClusterAction.doAction(BootstrapClusterAction.java:125)
at org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:131)
at org.apache.whirr.ClusterController.bootstrapCluster(ClusterController.java:137)
at org.apache.whirr.ClusterController.launchCluster(ClusterController.java:113)
at org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:69)
at org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:59)
at org.apache.cloudstack.api.command.user.emr.LaunchClusterCmd.execute(LaunchClusterCmd.java:57)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:505)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:355)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:302)
at com.cloud.api.ApiServlet.doGet(ApiServlet.java:66)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Caused by: java.util.concurrent.ExecutionException: java.io.IOException: Too many instance failed while bootstrapping! 0 successfully started instances while 0 instances failed
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
at java.util.concurrent.FutureTask.get(FutureTask.java:111)
at org.apache.whirr.actions.BootstrapClusterAction.doAction(BootstrapClusterAction.java:120)
... 30 more
Caused by: java.io.IOException: Too many instance failed while bootstrapping! 0 successfully started instances while 0 instances failed
... 32 more
INFO [whirr.state.ClusterStateStore] (729061754@qtp-385354117-0:) Unable to load cluster state, assuming it has no running nodes.
java.io.FileNotFoundException: /home/meng/.whirr/hadoop/instances (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at com.google.common.io.Files$FileByteSource.openStream(Files.java:124)
at com.google.common.io.Files$FileByteSource.openStream(Files.java:114)
at com.google.common.io.ByteSource$AsCharSource.openStream(ByteSource.java:287)
at com.google.common.io.CharStreams$3.getInput(CharStreams.java:508)
at com.google.common.io.CharStreams$3.getInput(CharStreams.java:505)
at com.google.common.io.CharStreams.readLines(CharStreams.java:319)
at com.google.common.io.Files.readLines(Files.java:690)
at org.apache.whirr.state.FileClusterStateStore.load(FileClusterStateStore.java:55)
at org.apache.whirr.state.ClusterStateStore.tryLoadOrEmpty(ClusterStateStore.java:59)
at org.apache.whirr.ClusterController.destroyCluster(ClusterController.java:226)
at org.apache.whirr.ClusterController.launchCluster(ClusterController.java:121)
at org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:69)
at org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:59)
at org.apache.cloudstack.api.command.user.emr.LaunchClusterCmd.execute(LaunchClusterCmd.java:57)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:505)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:355)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:302)
at com.cloud.api.ApiServlet.doGet(ApiServlet.java:66)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
INFO [whirr.actions.ScriptBasedClusterAction] (729061754@qtp-385354117-0:) Finished running destroy phase scripts on all cluster instances
INFO [whirr.actions.DestroyClusterAction] (729061754@qtp-385354117-0:) Destroying hadoop cluster
INFO [user.vm.DeployVMCmd] (Job-Executor-2:job-125) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|hadoop-7e2]Scope=interface com.cloud.dc.DataCenter; id=1
INFO [user.vm.DeployVMCmd] (Job-Executor-2:job-125) Unable to create a deployment for VM[User|hadoop-7e2]
com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|hadoop-7e2]Scope=interface com.cloud.dc.DataCenter; id=1
at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:186)
at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:198)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3464)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3450)
at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:379)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
INFO [cloud.api.ApiServer] (1403777256@qtp-385354117-5:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
ERROR [jclouds.compute] (user thread 1:) createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2526ms/op
java.util.concurrent.ExecutionException: java.lang.IllegalStateException: { "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:306)
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:293)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
at org.jclouds.concurrent.FutureIterables$1.run(FutureIterables.java:138)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.IllegalStateException: { "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }
at org.jclouds.cloudstack.handlers.CloudStackErrorHandler.handleError(CloudStackErrorHandler.java:78)
at org.jclouds.http.handlers.DelegatingErrorHandler.handleError(DelegatingErrorHandler.java:69)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.shouldContinue(BaseHttpCommandExecutorService.java:197)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.call(BaseHttpCommandExecutorService.java:167)
at org.jclouds.http.internal.BaseHttpCommandExecutorService$HttpResponseCallable.call(BaseHttpCommandExecutorService.java:135)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.http.internal.BaseHttpCommandExecutorService.submit(BaseHttpCommandExecutorService.java:132)
at org.jclouds.http.TransformingHttpCommandExecutorServiceImpl.submit(TransformingHttpCommandExecutorServiceImpl.java:54)
at org.jclouds.http.TransformingHttpCommandImpl.execute(TransformingHttpCommandImpl.java:73)
at org.jclouds.rest.internal.AsyncRestClientProxy.createListenableFutureForHttpRequestMappedToMethodAndArgs(AsyncRestClientProxy.java:254)
at org.jclouds.rest.internal.AsyncRestClientProxy.invoke(AsyncRestClientProxy.java:148)
at $Proxy142.getAsyncJob(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.jclouds.concurrent.internal.SyncProxy.invoke(SyncProxy.java:170)
at $Proxy143.getAsyncJob(Unknown Source)
at org.jclouds.cloudstack.strategy.BlockUntilJobCompletesAndReturnResult.apply(BlockUntilJobCompletesAndReturnResult.java:68)
at org.jclouds.cloudstack.compute.strategy.CloudStackComputeServiceAdapter.createNodeWithGroupEncodedIntoName(CloudStackComputeServiceAdapter.java:183)
at org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.createNodeWithGroupEncodedIntoName(AdaptingComputeServiceStrategies.java:186)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:82)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:66)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.http.internal.BaseHttpCommandExecutorService.submit(BaseHttpCommandExecutorService.java:132)
at org.jclouds.http.TransformingHttpCommandExecutorServiceImpl.submit(TransformingHttpCommandExecutorServiceImpl.java:54)
at org.jclouds.http.TransformingHttpCommandImpl.execute(TransformingHttpCommandImpl.java:73)
at org.jclouds.rest.internal.AsyncRestClientProxy.createListenableFutureForHttpRequestMappedToMethodAndArgs(AsyncRestClientProxy.java:254)
at org.jclouds.rest.internal.AsyncRestClientProxy.invoke(AsyncRestClientProxy.java:148)
at $Proxy142.getAsyncJob(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.jclouds.concurrent.internal.SyncProxy.invoke(SyncProxy.java:170)
at $Proxy143.getAsyncJob(Unknown Source)
at org.jclouds.cloudstack.strategy.BlockUntilJobCompletesAndReturnResult.apply(BlockUntilJobCompletesAndReturnResult.java:68)
at org.jclouds.cloudstack.compute.strategy.CloudStackComputeServiceAdapter.createNodeWithGroupEncodedIntoName(CloudStackComputeServiceAdapter.java:183)
at org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.createNodeWithGroupEncodedIntoName(AdaptingComputeServiceStrategies.java:186)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:82)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet$AddNode.call(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:66)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.createNodeInGroupWithNameAndTemplate(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:170)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.execute(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:125)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:215)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
at org.jclouds.concurrent.config.DescribingExecutorService.submit(DescribingExecutorService.java:89)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.createNodeInGroupWithNameAndTemplate(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:170)
at org.jclouds.compute.strategy.impl.CreateNodesWithGroupEncodedIntoNameThenAddToSet.execute(CreateNodesWithGroupEncodedIntoNameThenAddToSet.java:125)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:215)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
... 6 more
Caused by: org.jclouds.http.HttpResponseException: command: GET http://localhost:8080/client/api?response=json&command=queryAsyncJobResult&jobid=e3f210f6-9ede-4648-98df-6ba22881f80a HTTP/1.1 failed with response: HTTP/1.1 431 431; content: [{ "queryasyncjobresultresponse" : {"errorcode":431,"cserrorcode":9999,"errortext":"class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus"} }]
... 77 more
ERROR [jclouds.compute] (pool-4-thread-4:) createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2529ms/op
java.lang.RuntimeException: createNodesInGroup(hadoop), completed: 0/1, errors: 1, rate: 2529ms/op
at org.jclouds.concurrent.FutureIterables.awaitCompletion(FutureIterables.java:168)
at org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:219)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:55)
at org.apache.whirr.compute.NodeStarter.call(NodeStarter.java:30)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
INFO [cloud.api.ApiServer] (2033387022@qtp-385354117-4:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 4:) << illegal state destroying node(45fba7fd-1373-42a3-bca0-c4a87801a03a)
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 2:) << illegal state destroying node(c100e4d9-6a0b-4107-b4a3-0091dfd8cc45)
INFO [cloud.api.ApiServer] (259211805@qtp-385354117-7:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 5:) << illegal state destroying node(069fe417-9430-4f45-b321-fe88dba156d0)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 6:) << illegal state destroying node(367713c0-15fd-49e1-9a31-ff6595d273e0)
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 4:) << illegal state destroying node(45fba7fd-1373-42a3-bca0-c4a87801a03a)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 2:) << illegal state destroying node(c100e4d9-6a0b-4107-b4a3-0091dfd8cc45)
INFO [cloud.api.ApiServer] (259211805@qtp-385354117-7:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 5:) << illegal state destroying node(069fe417-9430-4f45-b321-fe88dba156d0)
INFO [cloud.api.ApiServer] (1403777256@qtp-385354117-5:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 6:) << illegal state destroying node(367713c0-15fd-49e1-9a31-ff6595d273e0)
INFO [user.vm.DeployVMCmd] (Job-Executor-3:job-126) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|hadoop-d83]Scope=interface com.cloud.dc.DataCenter; id=1
INFO [user.vm.DeployVMCmd] (Job-Executor-3:job-126) Unable to create a deployment for VM[User|hadoop-d83]
com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|hadoop-d83]Scope=interface com.cloud.dc.DataCenter; id=1
at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:186)
at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:198)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3464)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3450)
at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:379)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
INFO [user.vm.DeployVMCmd] (Job-Executor-4:job-127) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|hadoop-59a]Scope=interface com.cloud.dc.DataCenter; id=1
INFO [user.vm.DeployVMCmd] (Job-Executor-4:job-127) Unable to create a deployment for VM[User|hadoop-59a]
com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|hadoop-59a]Scope=interface com.cloud.dc.DataCenter; id=1
at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:186)
at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:198)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3464)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3450)
at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:379)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:162)
at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
INFO [cloud.api.ApiServer] (1403777256@qtp-385354117-5:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 4:) << illegal state destroying node(45fba7fd-1373-42a3-bca0-c4a87801a03a)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 2:) << illegal state destroying node(c100e4d9-6a0b-4107-b4a3-0091dfd8cc45)
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 5:) << illegal state destroying node(069fe417-9430-4f45-b321-fe88dba156d0)
INFO [cloud.api.ApiServer] (2033387022@qtp-385354117-4:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 6:) << illegal state destroying node(367713c0-15fd-49e1-9a31-ff6595d273e0)
INFO [cloud.vm.UserVmManagerImpl] (UserVm-Scavenger-1:) Found 4 vms to expunge.
INFO [network.security.SecurityGroupManagerImpl] (UserVm-Scavenger-1:) Disassociated 1 network groups from uservm 16
INFO [network.security.SecurityGroupManagerImpl] (UserVm-Scavenger-1:) Disassociated 1 network groups from uservm 17
INFO [network.security.SecurityGroupManagerImpl] (UserVm-Scavenger-1:) Disassociated 1 network groups from uservm 18
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 4:) << illegal state destroying node(45fba7fd-1373-42a3-bca0-c4a87801a03a)
INFO [cloud.api.ApiServer] (2033387022@qtp-385354117-4:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 2:) << illegal state destroying node(c100e4d9-6a0b-4107-b4a3-0091dfd8cc45)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 5:) << illegal state destroying node(069fe417-9430-4f45-b321-fe88dba156d0)
INFO [network.security.SecurityGroupManagerImpl] (UserVm-Scavenger-1:) Disassociated 1 network groups from uservm 19
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 6:) << illegal state destroying node(367713c0-15fd-49e1-9a31-ff6595d273e0)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 4:) << illegal state destroying node(45fba7fd-1373-42a3-bca0-c4a87801a03a)
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 2:) << illegal state destroying node(c100e4d9-6a0b-4107-b4a3-0091dfd8cc45)
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 5:) << illegal state destroying node(069fe417-9430-4f45-b321-fe88dba156d0)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 6:) << illegal state destroying node(367713c0-15fd-49e1-9a31-ff6595d273e0)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 4:) << illegal state destroying node(45fba7fd-1373-42a3-bca0-c4a87801a03a)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 2:) << illegal state destroying node(c100e4d9-6a0b-4107-b4a3-0091dfd8cc45)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 5:) << illegal state destroying node(069fe417-9430-4f45-b321-fe88dba156d0)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 6:) << illegal state destroying node(367713c0-15fd-49e1-9a31-ff6595d273e0)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 4:) << illegal state destroying node(45fba7fd-1373-42a3-bca0-c4a87801a03a)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 2:) << illegal state destroying node(c100e4d9-6a0b-4107-b4a3-0091dfd8cc45)
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 5:) << illegal state destroying node(069fe417-9430-4f45-b321-fe88dba156d0)
INFO [cloud.api.ApiServer] (1644793647@qtp-385354117-2:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 6:) << illegal state destroying node(367713c0-15fd-49e1-9a31-ff6595d273e0)
INFO [cloud.api.ApiServer] (1640835535@qtp-385354117-6:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 5:) << illegal state destroying node(069fe417-9430-4f45-b321-fe88dba156d0)
INFO [cloud.api.ApiServer] (1403777256@qtp-385354117-5:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 2:) << illegal state destroying node(c100e4d9-6a0b-4107-b4a3-0091dfd8cc45)
INFO [cloud.api.ApiServer] (259211805@qtp-385354117-7:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 4:) << illegal state destroying node(45fba7fd-1373-42a3-bca0-c4a87801a03a)
INFO [cloud.api.ApiServer] (2033387022@qtp-385354117-4:) class org.apache.cloudstack.api.response.AsyncJobResponse declares multiple JSON fields named jobstatus
WARN [jclouds.compute] (user thread 6:) << illegal state destroying node(367713c0-15fd-49e1-9a31-ff6595d273e0)
INFO [whirr.actions.DestroyClusterAction] (729061754@qtp-385354117-0:) Cluster hadoop destroyed
Thanks,
meng han