You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@stratos.apache.org by Thushara Ranawaka <th...@wso2.com> on 2014/09/28 13:08:03 UTC

Member instance is not getting created

Hi,
I push a docker image into openstack, successfully created the image. Then
configure the cartridge in stratos and subscribe to that cartridge which is
couchdb-cartridge. In the carbon log i found below scenario is happening

TID: [0] [STRATOS] [2014-09-28 14:58:00,214]  INFO
{org.apache.stratos.autoscaler.client.cloud.controller.CloudControllerClient}
-  Trying to spawn an instance via cloud controller: [cluster]
mycouchdb.couchdb.domain [partition] P1 [lb-cluster] null
[network-partition-id] openstack
{org.apache.stratos.autoscaler.client.cloud.controller.CloudControllerClient}

I waited for several minutes and i got the following error log.(full log
attached below).

TID: [0] [STRATOS] [2014-09-28 15:03:00,234]  INFO
{org.apache.axis2.transport.http.HTTPSender} -  Unable to sendViaPost to
url[https://dev.stratos.org:9445/services/CloudControllerService]
{org.apache.axis2.transport.http.HTTPSender}
java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
at sun.security.ssl.InputRecord.read(InputRecord.java:480)
at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)
at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)
at
org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)
at
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1413)
at
org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)
at
org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
at
org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
at
org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
at
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
at
org.apache.axis2.transport.http.AbstractHTTPSender.executeMethod(AbstractHTTPSender.java:622)
at
org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:193)
at org.apache.axis2.transport.http.HTTPSender.send(HTTPSender.java:75)
at
org.apache.axis2.transport.http.CommonsHTTPTransportSender.writeMessageWithCommons(CommonsHTTPTransportSender.java:451)
at
org.apache.axis2.transport.http.CommonsHTTPTransportSender.invoke(CommonsHTTPTransportSender.java:278)
at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442)
at
org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:430)
at
org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225)
at org.apache.axis2.client.OperationClient.execute(OperationClient.java:149)
at
org.apache.stratos.cloud.controller.stub.CloudControllerServiceStub.startInstance(CloudControllerServiceStub.java:1139)
...

I attached the Dockerfile, run_script and the init.sh for more information.

Thanks,
-- 
Thushara Kasun Ranawaka
Software Engineer
WSO2 Inc.; <http://www.wso2.com>
lean.enterprise.middleware
Mobile : *+94 (0) 773438949*
*thusharak@wso2.com <th...@wso2.com>*

Re: Member instance is not getting created

Posted by Manula Chathurika Thantriwatte <ma...@wso2.com>.
Hi Thushara,

Can you send the partition, autoscaling and deployment policy files which
you have used to deploy in Stratos.

Thanks !

On Sun, Sep 28, 2014 at 4:38 PM, Thushara Ranawaka <th...@wso2.com>
wrote:

> Hi,
> I push a docker image into openstack, successfully created the image. Then
> configure the cartridge in stratos and subscribe to that cartridge which is
> couchdb-cartridge. In the carbon log i found below scenario is happening
>
> TID: [0] [STRATOS] [2014-09-28 14:58:00,214]  INFO
> {org.apache.stratos.autoscaler.client.cloud.controller.CloudControllerClient}
> -  Trying to spawn an instance via cloud controller: [cluster]
> mycouchdb.couchdb.domain [partition] P1 [lb-cluster] null
> [network-partition-id] openstack
> {org.apache.stratos.autoscaler.client.cloud.controller.CloudControllerClient}
>
> I waited for several minutes and i got the following error log.(full log
> attached below).
>
> TID: [0] [STRATOS] [2014-09-28 15:03:00,234]  INFO
> {org.apache.axis2.transport.http.HTTPSender} -  Unable to sendViaPost to
> url[https://dev.stratos.org:9445/services/CloudControllerService]
> {org.apache.axis2.transport.http.HTTPSender}
> java.net.SocketTimeoutException: Read timed out
> at java.net.SocketInputStream.socketRead0(Native Method)
> at java.net.SocketInputStream.read(SocketInputStream.java:152)
> at java.net.SocketInputStream.read(SocketInputStream.java:122)
> at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
> at sun.security.ssl.InputRecord.read(InputRecord.java:480)
> at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
> at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
> at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
> at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
> at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
> at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)
> at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)
> at
> org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)
> at
> org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1413)
> at
> org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)
> at
> org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
> at
> org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
> at
> org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
> at
> org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
> at
> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
> at
> org.apache.axis2.transport.http.AbstractHTTPSender.executeMethod(AbstractHTTPSender.java:622)
> at
> org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:193)
> at org.apache.axis2.transport.http.HTTPSender.send(HTTPSender.java:75)
> at
> org.apache.axis2.transport.http.CommonsHTTPTransportSender.writeMessageWithCommons(CommonsHTTPTransportSender.java:451)
> at
> org.apache.axis2.transport.http.CommonsHTTPTransportSender.invoke(CommonsHTTPTransportSender.java:278)
> at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442)
> at
> org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:430)
> at
> org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225)
> at
> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149)
> at
> org.apache.stratos.cloud.controller.stub.CloudControllerServiceStub.startInstance(CloudControllerServiceStub.java:1139)
> ...
>
> I attached the Dockerfile, run_script and the init.sh for more information.
>
> Thanks,
> --
> Thushara Kasun Ranawaka
> Software Engineer
> WSO2 Inc.; <http://www.wso2.com>
> lean.enterprise.middleware
> Mobile : *+94 (0) 773438949 <%2B94%20%280%29%20773438949>*
> *thusharak@wso2.com <th...@wso2.com>*
>



-- 
Regards,
Manula Chathurika Thantriwatte
Software Engineer
WSO2 Inc. : http://wso2.com
lean . enterprise . middleware

email : manulac@wso2.com / manula@apache.org
phone : +94 772492511
blog : http://manulachathurika.blogspot.com/

Re: Member instance is not getting created

Posted by Thushara Ranawaka <th...@wso2.com>.
Hi Manula,
Yes, I was abel to. there were several mistakes that i have made in the
dockerfile and cartridge configuration as well. Now couchdb cartridge is up
and running few code level and configuration level steps to be done.

Corrected docker file and configuration files attached bellow.
Thanks,


On Mon, Sep 29, 2014 at 4:38 PM, Manula Chathurika Thantriwatte <
manulac@wso2.com> wrote:

> Hi Thushara,
>
> Would you be able to solve the problem.
>
> Thanks !
>
> On Mon, Sep 29, 2014 at 10:36 AM, Udara Liyanage <ud...@wso2.com> wrote:
>
>>
>> Hi Thushara,
>>
>> Could you please check what I and Melan have suggested.
>> I suspect little it is due to partitions or policies.
>>
>>
>> Touched, not typed. Erroneous words are a feature, not a typo.
>>
>
>
>
> --
> Regards,
> Manula Chathurika Thantriwatte
> Software Engineer
> WSO2 Inc. : http://wso2.com
> lean . enterprise . middleware
>
> email : manulac@wso2.com / manula@apache.org
> phone : +94 772492511
> blog : http://manulachathurika.blogspot.com/
>
>
>
>


-- 
Thushara Kasun Ranawaka
Software Engineer
WSO2 Inc.; <http://www.wso2.com>
lean.enterprise.middleware
Mobile : *+94 (0) 773438949*
*thusharak@wso2.com <th...@wso2.com>*

Re: Member instance is not getting created

Posted by Manula Chathurika Thantriwatte <ma...@wso2.com>.
Hi Thushara,

Would you be able to solve the problem.

Thanks !

On Mon, Sep 29, 2014 at 10:36 AM, Udara Liyanage <ud...@wso2.com> wrote:

>
> Hi Thushara,
>
> Could you please check what I and Melan have suggested.
> I suspect little it is due to partitions or policies.
>
>
> Touched, not typed. Erroneous words are a feature, not a typo.
>



-- 
Regards,
Manula Chathurika Thantriwatte
Software Engineer
WSO2 Inc. : http://wso2.com
lean . enterprise . middleware

email : manulac@wso2.com / manula@apache.org
phone : +94 772492511
blog : http://manulachathurika.blogspot.com/

Re: Member instance is not getting created

Posted by Udara Liyanage <ud...@wso2.com>.
Hi Thushara,

Could you please check what I and Melan have suggested.
I suspect little it is due to partitions or policies.


Touched, not typed. Erroneous words are a feature, not a typo.

Re: Member instance is not getting created

Posted by Thushara Ranawaka <th...@wso2.com>.
Hi Manula,

 Kindly find requested partition, autoscaling and deployment policy
files respectively.

{
  "id": "P1",
  "partitionMin": 0,
  "partitionMax": 0,
  "provider": "openstack",
  "property": [
    {
      "name": "region",
      "value": "RegionOne"
    }
  ]
}



{
  "id": "economyPolicy",
  "loadThresholds": {
    "requestsInFlight": {
      "average": 50,
      "secondDerivative": 0,
      "gradient": 0,
      "scaleDownMarginOfGradient": 1,
      "scaleDownMarginOfSecondDerivative": 0.2
    },
    "memoryConsumption": {
      "average": 70,
      "secondDerivative": 0,
      "gradient": 0,
      "scaleDownMarginOfGradient": 1,
      "scaleDownMarginOfSecondDerivative": 0.2
    },
    "loadAverage": {
      "average": 70,
      "secondDerivative": 0,
      "gradient": 0,
      "scaleDownMarginOfGradient": 1,
      "scaleDownMarginOfSecondDerivative": 0.2
    }
  }
}






{
  "id": "couchdb-openstack",
  "partitionGroup": [
    {
      "id": "openstack",
      "partitionAlgo": "one after another",
      "partition": [
        {
          "id": "P1",
          "partitionMin": 1,
          "partitionMax": 3,
          "provider": "openstack",
          "property": [
            {
              "name": "region",
              "value": "RegionOne"
            }
          ]
        }
      ]
    }
  ]
}


Thanks,

On Sun, Sep 28, 2014 at 9:30 PM, Melan Nimesh <me...@apache.org> wrote:

>
>
> On Sun, Sep 28, 2014 at 8:59 PM, Suhan Dharmasuriya <su...@wso2.com>
> wrote:
>
>> Hi,
>>
>> I noticed the following error in Thushara's carbon_error.log.
>> Is this caused by the CouchDB cartridge configuration in stratos
>> configuration?
>>
>> TID: [0] [STRATOS] [2014-09-28 15:03:00,261] ERROR
>> {org.apache.stratos.autoscaler.monitor.ClusterMonitor} -  Cluster monitor:
>> Monitor failed.ClusterMonitor [clusterId=mycouchdb.couchdb.domain,
>> serviceId=couchdb, deploymentPolicy=Deployment Policy [id]couchdb-openstack
>> [partitions]
>> [org.apache.stratos.cloud.controller.stub.deployment.partition.Partition@6c1247ca],
>> autoscalePolicy=ASPolicy [id=economyPolicy, displayName=null,
>> description=null], lbReferenceType=no.load.balancer]
>> {org.apache.stratos.autoscaler.monitor.ClusterMonitor}
>> *Exception executing consequence for rule "Minimum Rule" in
>> org.apache.stratos.autoscaler.rule: *[Error:
>> $delegator.delegateSpawn($ctxt, clusterId, lbRef): Cannot spawn an instance]
>> [Near : {... $delegator.delegateSpawn($ctxt ....}]
>>              ^
>> [Line: 1, Column: 1]
>>
>
> It seems CC client timeout happened before spawning an instance. default
> time value is 300000. Could you increase that value and try again? it's
> available in autoscaler.xml's
> configuration->autoscaler->cloudController->clientTimeout element.
>
> Thanks,
> Melan
>
>
>>
>> Thanks,
>> Suhan
>>
>> On Sun, Sep 28, 2014 at 8:19 PM, Udara Liyanage <ud...@wso2.com> wrote:
>>
>>> Hi,
>>>
>>> Could you please check whether CC is accessible via this
>>>
>>> https://dev.stratos.org:9445/services/CloudControllerService
>>>
>>> ssh in to dev.Stratos.org and check whether CC is running on port 9445
>>>
>>>
>>>
>>> Touched, not typed. Erroneous words are a feature, not a typo.
>>>
>>
>>
>>
>> --
>> Suhan Dharmasuriya
>> Software Engineer - Test Automation
>>
>> *WSO2, Inc. *
>>
>> lean . enterprise . middleware
>> Tel: +94 112 145345
>> Mob: +94 779 869138
>> Blog: http://suhan-opensource.blogspot.com/
>>
>
>
>
> --
> Melan Nimesh Jayasinghage
>



-- 
Thushara Kasun Ranawaka
Software Engineer
WSO2 Inc.; <http://www.wso2.com>
lean.enterprise.middleware
Mobile : *+94 (0) 773438949*
*thusharak@wso2.com <th...@wso2.com>*

Re: Member instance is not getting created

Posted by Melan Nimesh <me...@apache.org>.
On Sun, Sep 28, 2014 at 8:59 PM, Suhan Dharmasuriya <su...@wso2.com> wrote:

> Hi,
>
> I noticed the following error in Thushara's carbon_error.log.
> Is this caused by the CouchDB cartridge configuration in stratos
> configuration?
>
> TID: [0] [STRATOS] [2014-09-28 15:03:00,261] ERROR
> {org.apache.stratos.autoscaler.monitor.ClusterMonitor} -  Cluster monitor:
> Monitor failed.ClusterMonitor [clusterId=mycouchdb.couchdb.domain,
> serviceId=couchdb, deploymentPolicy=Deployment Policy [id]couchdb-openstack
> [partitions]
> [org.apache.stratos.cloud.controller.stub.deployment.partition.Partition@6c1247ca],
> autoscalePolicy=ASPolicy [id=economyPolicy, displayName=null,
> description=null], lbReferenceType=no.load.balancer]
> {org.apache.stratos.autoscaler.monitor.ClusterMonitor}
> *Exception executing consequence for rule "Minimum Rule" in
> org.apache.stratos.autoscaler.rule: *[Error:
> $delegator.delegateSpawn($ctxt, clusterId, lbRef): Cannot spawn an instance]
> [Near : {... $delegator.delegateSpawn($ctxt ....}]
>              ^
> [Line: 1, Column: 1]
>

It seems CC client timeout happened before spawning an instance. default
time value is 300000. Could you increase that value and try again? it's
available in autoscaler.xml's
configuration->autoscaler->cloudController->clientTimeout element.

Thanks,
Melan


>
> Thanks,
> Suhan
>
> On Sun, Sep 28, 2014 at 8:19 PM, Udara Liyanage <ud...@wso2.com> wrote:
>
>> Hi,
>>
>> Could you please check whether CC is accessible via this
>>
>> https://dev.stratos.org:9445/services/CloudControllerService
>>
>> ssh in to dev.Stratos.org and check whether CC is running on port 9445
>>
>>
>>
>> Touched, not typed. Erroneous words are a feature, not a typo.
>>
>
>
>
> --
> Suhan Dharmasuriya
> Software Engineer - Test Automation
>
> *WSO2, Inc. *
>
> lean . enterprise . middleware
> Tel: +94 112 145345
> Mob: +94 779 869138
> Blog: http://suhan-opensource.blogspot.com/
>



-- 
Melan Nimesh Jayasinghage

Re: Member instance is not getting created

Posted by Suhan Dharmasuriya <su...@wso2.com>.
Hi,

I noticed the following error in Thushara's carbon_error.log.
Is this caused by the CouchDB cartridge configuration in stratos
configuration?

TID: [0] [STRATOS] [2014-09-28 15:03:00,261] ERROR
{org.apache.stratos.autoscaler.monitor.ClusterMonitor} -  Cluster monitor:
Monitor failed.ClusterMonitor [clusterId=mycouchdb.couchdb.domain,
serviceId=couchdb, deploymentPolicy=Deployment Policy [id]couchdb-openstack
[partitions]
[org.apache.stratos.cloud.controller.stub.deployment.partition.Partition@6c1247ca],
autoscalePolicy=ASPolicy [id=economyPolicy, displayName=null,
description=null], lbReferenceType=no.load.balancer]
{org.apache.stratos.autoscaler.monitor.ClusterMonitor}
*Exception executing consequence for rule "Minimum Rule" in
org.apache.stratos.autoscaler.rule: *[Error:
$delegator.delegateSpawn($ctxt, clusterId, lbRef): Cannot spawn an instance]
[Near : {... $delegator.delegateSpawn($ctxt ....}]
             ^
[Line: 1, Column: 1]

Thanks,
Suhan

On Sun, Sep 28, 2014 at 8:19 PM, Udara Liyanage <ud...@wso2.com> wrote:

> Hi,
>
> Could you please check whether CC is accessible via this
>
> https://dev.stratos.org:9445/services/CloudControllerService
>
> ssh in to dev.Stratos.org and check whether CC is running on port 9445
>
>
>
> Touched, not typed. Erroneous words are a feature, not a typo.
>



-- 
Suhan Dharmasuriya
Software Engineer - Test Automation

*WSO2, Inc. *

lean . enterprise . middleware
Tel: +94 112 145345
Mob: +94 779 869138
Blog: http://suhan-opensource.blogspot.com/

Re: Member instance is not getting created

Posted by Udara Liyanage <ud...@wso2.com>.
Hi,

Could you please check whether CC is accessible via this

https://dev.stratos.org:9445/services/CloudControllerService

ssh in to dev.Stratos.org and check whether CC is running on port 9445



Touched, not typed. Erroneous words are a feature, not a typo.