You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@stratos.apache.org by "Udara Liyanage (JIRA)" <ji...@apache.org> on 2014/11/07 07:53:33 UTC

[jira] [Commented] (STRATOS-941) Error while undeploying application

    [ https://issues.apache.org/jira/browse/STRATOS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201696#comment-14201696 ] 

Udara Liyanage commented on STRATOS-941:
----------------------------------------

Another instance


[2014-11-07 12:21:41,874]  INFO {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -  Un-deploying the [application] mysql-only-appby marking it as terminating..
[2014-11-07 12:21:41,875]  INFO {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -  Applicationmysql-only-app updated as terminating
[2014-11-07 12:21:41,875]  INFO {org.apache.stratos.autoscaler.monitor.application.ApplicationMonitor} -  [ApplicationMonitor] mysql-only-app state changes from Created to Terminating
[2014-11-07 12:21:41,876]  INFO {org.apache.stratos.autoscaler.event.publisher.ClusterStatusEventPublisher} -  Publishing Cluster Terminating event for [application]: null [cluster]: mymysql.mysql.domain
[2014-11-07 12:21:41,888]  INFO {org.apache.stratos.messaging.domain.topology.lifecycle.LifeCycleStateManager} -  Topology element [ mymysql.mysql.domain ]'s life Cycle State changed from [ Created ] to [ Terminating ]
[2014-11-07 12:21:41,896]  INFO {org.apache.stratos.autoscaler.applications.topic.ApplicationsEventPublisher} -  Publishing Application terminated event for [application]: mysql-only-app
[2014-11-07 12:21:41,911] ERROR {org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator} -  Failed to retrieve application status event message
java.lang.RuntimeException: Failed to process message using available message processors: [type] org.apache.stratos.messaging.event.applications.ApplicationTerminatingEvent [body] {"appId":"mysql-only-app"}
	at org.apache.stratos.messaging.message.processor.applications.ApplicationUndeployedMessageProcessor.process(ApplicationUndeployedMessageProcessor.java:93)
	at org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatedMessageProcessor.process(ApplicationTerminatedMessageProcessor.java:85)
	at org.apache.stratos.messaging.message.processor.applications.CompleteApplicationsMessageProcessor.process(CompleteApplicationsMessageProcessor.java:69)
	at org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatingMessageProcessor.process(ApplicationTerminatingMessageProcessor.java:72)
	at org.apache.stratos.messaging.message.processor.applications.ApplicationInactivatedMessageProcessor.process(ApplicationInactivatedMessageProcessor.java:72)
	at org.apache.stratos.messaging.message.processor.applications.ApplicationCreatedMessageProcessor.process(ApplicationCreatedMessageProcessor.java:67)
	at org.apache.stratos.messaging.message.processor.applications.ApplicationActivatedMessageProcessor.process(ApplicationActivatedMessageProcessor.java:72)
	at org.apache.stratos.messaging.message.processor.applications.GroupTerminatingProcessor.process(GroupTerminatingProcessor.java:69)
	at org.apache.stratos.messaging.message.processor.applications.GroupTerminatedProcessor.process(GroupTerminatedProcessor.java:69)
	at org.apache.stratos.messaging.message.processor.applications.GroupInActivateProcessor.process(GroupInActivateProcessor.java:69)
	at org.apache.stratos.messaging.message.processor.applications.GroupActivatedProcessor.process(GroupActivatedProcessor.java:69)
	at org.apache.stratos.messaging.message.processor.applications.GroupResetProcessor.process(GroupResetProcessor.java:69)
	at org.apache.stratos.messaging.message.processor.MessageProcessorChain.process(MessageProcessorChain.java:60)
	at org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator.run(ApplicationsEventMessageDelegator.java:71)
	at java.lang.Thread.run(Thread.java:662)
[2014-11-07 12:21:41,952]  INFO {org.apache.stratos.cloud.controller.topology.TopologyEventPublisher} -  Publishing Cluster terminating event: [appId] null [cluster id] mymysql.mysql.domain
[2014-11-07 12:21:41,968]  INFO {org.apache.stratos.autoscaler.event.receiver.topology.AutoscalerTopologyEventReceiver} -  [ClusterTerminatingEvent] Received: class org.apache.stratos.messaging.event.topology.ClusterTerminatingEvent
[2014-11-07 12:21:41,968]  INFO {org.apache.stratos.autoscaler.monitor.cluster.AbstractClusterMonitor} -  [Cluster] mymysql.mysql.domain is not notifying the parent, since it is in Terminating State
[2014-11-07 12:21:41,969]  INFO {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} -  Starting to terminate all members in Network Partition [ ec2 ], Partition [ p1 ]
[2014-11-07 12:21:41,969]  INFO {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} -  Terminating pending member [member id] mymysql.mysql.domainc81c80b9-2449-4064-8d6e-cf5a746e26ed
[2014-11-07 12:21:41,970]  INFO {org.apache.stratos.autoscaler.client.CloudControllerClient} -  Terminating instance via cloud controller: [member] mymysql.mysql.domainc81c80b9-2449-4064-8d6e-cf5a746e26ed
[2014-11-07 12:21:41,984]  INFO {org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl} -  Starting to terminate an instance with member id : mymysql.mysql.domainc81c80b9-2449-4064-8d6e-cf5a746e26ed in partition id: p1 of cluster id: mymysql.mysql.domain and of cartridge type: mysql



> Error while undeploying application
> -----------------------------------
>
>                 Key: STRATOS-941
>                 URL: https://issues.apache.org/jira/browse/STRATOS-941
>             Project: Stratos
>          Issue Type: Bug
>            Reporter: Udara Liyanage
>
> [2014-11-07 12:16:17,328]  INFO {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -  Un-deploying the [application] mysql-onlyby marking it as terminating..
> [2014-11-07 12:16:17,329]  INFO {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -  Applicationmysql-only updated as terminating
> [2014-11-07 12:16:17,329]  INFO {org.apache.stratos.autoscaler.monitor.application.ApplicationMonitor} -  [ApplicationMonitor] mysql-only state changes from Created to Terminating
> [2014-11-07 12:16:17,331]  INFO {org.apache.stratos.autoscaler.event.publisher.ClusterStatusEventPublisher} -  Publishing Cluster Terminating event for [application]: null [cluster]: mymysql.mysql.domain
> [2014-11-07 12:16:17,347]  INFO {org.apache.stratos.messaging.domain.topology.lifecycle.LifeCycleStateManager} -  Topology element [ mymysql.mysql.domain ]'s life Cycle State changed from [ Created ] to [ Terminating ]
> [2014-11-07 12:16:17,364]  INFO {org.apache.stratos.autoscaler.applications.topic.ApplicationsEventPublisher} -  Publishing Application terminated event for [application]: mysql-only
> [2014-11-07 12:16:17,378] ERROR {org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator} -  Failed to retrieve application status event message
> java.lang.RuntimeException: Failed to process message using available message processors: [type] org.apache.stratos.messaging.event.applications.ApplicationTerminatingEvent [body] {"appId":"mysql-only"}
> 	at org.apache.stratos.messaging.message.processor.applications.ApplicationUndeployedMessageProcessor.process(ApplicationUndeployedMessageProcessor.java:93)
> 	at org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatedMessageProcessor.process(ApplicationTerminatedMessageProcessor.java:85)
> 	at org.apache.stratos.messaging.message.processor.applications.CompleteApplicationsMessageProcessor.process(CompleteApplicationsMessageProcessor.java:69)
> 	at org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatingMessageProcessor.process(ApplicationTerminatingMessageProcessor.java:72)
> 	at org.apache.stratos.messaging.message.processor.applications.ApplicationInactivatedMessageProcessor.process(ApplicationInactivatedMessageProcessor.java:72)
> 	at org.apache.stratos.messaging.message.processor.applications.ApplicationCreatedMessageProcessor.process(ApplicationCreatedMessageProcessor.java:67)
> 	at org.apache.stratos.messaging.message.processor.applications.ApplicationActivatedMessageProcessor.process(ApplicationActivatedMessageProcessor.java:72)
> 	at org.apache.stratos.messaging.message.processor.applications.GroupTerminatingProcessor.process(GroupTerminatingProcessor.java:69)
> 	at org.apache.stratos.messaging.message.processor.applications.GroupTerminatedProcessor.process(GroupTerminatedProcessor.java:69)
> 	at org.apache.stratos.messaging.message.processor.applications.GroupInActivateProcessor.process(GroupInActivateProcessor.java:69)
> 	at org.apache.stratos.messaging.message.processor.applications.GroupActivatedProcessor.process(GroupActivatedProcessor.java:69)
> 	at org.apache.stratos.messaging.message.processor.applications.GroupResetProcessor.process(GroupResetProcessor.java:69)
> 	at org.apache.stratos.messaging.message.processor.MessageProcessorChain.process(MessageProcessorChain.java:60)
> 	at org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator.run(ApplicationsEventMessageDelegator.java:71)
> 	at java.lang.Thread.run(Thread.java:662)
> [2014-11-07 12:16:17,445]  INFO {org.apache.stratos.cloud.controller.topology.TopologyEventPublisher} -  Publishing Cluster terminating event: [appId] null [cluster id] mymysql.mysql.domain
> [2014-11-07 12:16:17,458]  INFO {org.apache.stratos.messaging.domain.topology.lifecycle.LifeCycleStateManager} -  Topology element [ mymysql.mysql.domain ]'s life Cycle State changed from [ Created ] to [ Terminating ]
> [2014-11-07 12:16:17,460]  INFO {org.apache.stratos.autoscaler.event.receiver.topology.AutoscalerTopologyEventReceiver} -  [ClusterTerminatingEvent] Received: class org.apache.stratos.messaging.event.topology.ClusterTerminatingEvent
> [2014-11-07 12:16:17,461]  INFO {org.apache.stratos.autoscaler.monitor.cluster.AbstractClusterMonitor} -  [Cluster] mymysql.mysql.domain is not notifying the parent, since it is in Terminating State
> [2014-11-07 12:16:17,469]  INFO {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} -  Starting to terminate all members in Network Partition [ ec2 ], Partition [ p1 ]
> [2014-11-07 12:16:17,469]  INFO {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} -  Terminating pending member [member id] mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> [2014-11-07 12:16:17,469]  INFO {org.apache.stratos.autoscaler.client.CloudControllerClient} -  Terminating instance via cloud controller: [member] mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> [2014-11-07 12:16:17,481] ERROR {org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl} -  Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> [2014-11-07 12:16:17,482] ERROR {org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver} -  Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> org.apache.stratos.cloud.controller.exception.InvalidMemberException: Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> 	at org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl.terminateInstance(CloudControllerServiceImpl.java:619)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212)
> 	at org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver.invokeBusinessLogic(RPCInOnlyMessageReceiver.java:66)
> 	at org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110)
> 	at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
> 	at org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:172)
> 	at org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:146)
> 	at org.wso2.carbon.core.transports.CarbonServlet.doPost(CarbonServlet.java:231)
> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> 	at org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
> 	at org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)
> 	at org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)
> 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
> 	at org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)
> 	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
> 	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> 	at org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61)
> 	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
> 	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> 	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
> 	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
> 	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
> 	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
> 	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
> 	at org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:178)
> 	at org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47)
> 	at org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:56)
> 	at org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47)
> 	at org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:141)
> 	at org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:156)
> 	at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936)
> 	at org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:52)
> 	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
> 	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
> 	at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
> 	at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
> 	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1653)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> 	at java.lang.Thread.run(Thread.java:662)
> [2014-11-07 12:16:17,515] ERROR {org.apache.stratos.autoscaler.client.CloudControllerClient} -  Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> org.apache.axis2.AxisFault: Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> 	at org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531)
> 	at org.apache.axis2.description.RobustOutOnlyAxisOperation$RobustOutOnlyOperationClient.handleResponse(RobustOutOnlyAxisOperation.java:91)
> 	at org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445)
> 	at org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225)
> 	at org.apache.axis2.client.OperationClient.execute(OperationClient.java:149)
> 	at org.apache.stratos.cloud.controller.stub.CloudControllerServiceStub.terminateInstance(CloudControllerServiceStub.java:1832)
> 	at org.apache.stratos.autoscaler.client.CloudControllerClient.terminate(CloudControllerClient.java:250)
> 	at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.terminateMember(VMClusterMonitor.java:714)
> 	at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.access$100(VMClusterMonitor.java:55)
> 	at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor$1.run(VMClusterMonitor.java:693)
> 	at java.lang.Thread.run(Thread.java:662)
> [2014-11-07 12:16:17,516] ERROR {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} -  Unable to terminate member [member id ] mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> org.apache.stratos.autoscaler.exception.TerminationException: Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> 	at org.apache.stratos.autoscaler.client.CloudControllerClient.terminate(CloudControllerClient.java:258)
> 	at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.terminateMember(VMClusterMonitor.java:714)
> 	at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.access$100(VMClusterMonitor.java:55)
> 	at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor$1.run(VMClusterMonitor.java:693)
> 	at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.axis2.AxisFault: Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145
> 	at org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531)
> 	at org.apache.axis2.description.RobustOutOnlyAxisOperation$RobustOutOnlyOperationClient.handleResponse(RobustOutOnlyAxisOperation.java:91)
> 	at org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445)
> 	at org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225)
> 	at org.apache.axis2.client.OperationClient.execute(OperationClient.java:149)
> 	at org.apache.stratos.cloud.controller.stub.CloudControllerServiceStub.terminateInstance(CloudControllerServiceStub.java:1832)
> 	at org.apache.stratos.autoscaler.client.CloudControllerClient.terminate(CloudControllerClient.java:250)
> 	... 4 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)