You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@stratos.apache.org by Manula Chathurika Thantriwatte <ma...@wso2.com> on 2015/01/12 10:31:51 UTC

Error while starting pod - from pending state to running state

Hi,

I'm getting the following error when running kubernetes. I'm using master
branch. Is anyone expecting this before.

[2015-01-12 09:27:21,782]  INFO
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Waiting pod status to be changed to running: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
[2015-01-12 09:27:26,813]  INFO
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Waiting pod status to be changed to running: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
[2015-01-12 09:27:31,834]  INFO
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Waiting pod status to be changed to running: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
[2015-01-12 09:27:36,854]  INFO
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Waiting pod status to be changed to running: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
[2015-01-12 09:27:41,882]  INFO
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Waiting pod status to be changed to running: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
[2015-01-12 09:27:41,882] ERROR
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Pod status did not change to running within 120 sec, hence terminating
member: [cluster-id] php.php.domain [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
[replication-controller-id]
php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015
[2015-01-12 09:27:41,882] ERROR
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Could not terminate container, member context not found: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
[2015-01-12 09:27:41,884] ERROR
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Could not start container: [cartridge-type] php [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
java.lang.IllegalArgumentException: Could not terminate container, member
context not found: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:625)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:534)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.waitForPodToBeActivated(KubernetesIaas.java:323)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:216)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startInstance(KubernetesIaas.java:115)
at
org.apache.stratos.cloud.controller.services.impl.InstanceCreator.startInstance(InstanceCreator.java:102)
at
org.apache.stratos.cloud.controller.services.impl.InstanceCreator.run(InstanceCreator.java:62)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
[2015-01-12 09:27:41,886] ERROR
{org.apache.stratos.cloud.controller.services.impl.InstanceCreator} -
 Could not start instance: [cartridge-type] php [cluster-id] php.php.domain
java.lang.IllegalStateException: Could not start container:
[cartridge-type] php [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:236)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startInstance(KubernetesIaas.java:115)
at
org.apache.stratos.cloud.controller.services.impl.InstanceCreator.startInstance(InstanceCreator.java:102)
at
org.apache.stratos.cloud.controller.services.impl.InstanceCreator.run(InstanceCreator.java:62)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.IllegalArgumentException: Could not terminate
container, member context not found: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:625)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:534)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.waitForPodToBeActivated(KubernetesIaas.java:323)
at
org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:216)
... 6 more

Thanks !

-- 
Regards,
Manula Chathurika Thantriwatte
Software Engineer
WSO2 Inc. : http://wso2.com
lean . enterprise . middleware

email : manulac@wso2.com / manula@apache.org
phone : +94 772492511
blog : http://manulachathurika.blogspot.com/

Re: Error while starting pod - from pending state to running state

Posted by Manula Chathurika Thantriwatte <ma...@wso2.com>.
Hi Imesh,

Yes, I already pull the stratos/php:4.1.0-alpha image in the Kubernetes
host before running the sample application. I got the pull from yesterday
and done this test. I'll done another test and verify this.

Thanks !

On Mon, Jan 12, 2015 at 10:51 PM, Imesh Gunaratne <im...@apache.org> wrote:

> Regarding the following error:
>
> [2015-01-12 09:27:41,884] ERROR
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Could not start container: [cartridge-type] php [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> java.lang.IllegalArgumentException: Could not terminate container, member
> context not found: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>
> It looks like you are running on an old codebase, now cloud controller
> does not terminate the container if it didn't start properly. It is handled
> by Autoscaler. Can you please verify whether you are running on the latest
> build?
>
> On Mon, Jan 12, 2015 at 10:45 PM, Imesh Gunaratne <im...@apache.org>
> wrote:
>
>> Hi Manula,
>>
>> There seems to be a problem with your Kubernetes setup, pod status has
>> not changed to Running within 120 seconds:
>>
>> [2015-01-12 09:27:41,882] ERROR {org.apache.stratos.cloud.
>> controller.iaases.kubernetes.KubernetesIaas} -  Pod status did not
>> change to running within 120 sec, hence terminating member: [cluster-id]
>> php.php.domain [member-id] php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> [replication-controller-id] php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> [pod-id] php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>>
>> Did you pull the stratos/php:4.1.0-alpha image in the Kubernetes host
>> before running the sample application? If not this error may occur as it
>> would take time to pull the image for the first time.
>>
>> Following seems to be an issue, container termination logic has not
>> worked properly:
>> [2015-01-12 09:27:41,884] ERROR
>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>  Could not start container: [cartridge-type] php [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> java.lang.IllegalArgumentException: Could not terminate container, member
>> context not found: [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>>
>> I will have a look at this.
>>
>> Thanks
>>
>> On Mon, Jan 12, 2015 at 3:01 PM, Manula Chathurika Thantriwatte <
>> manulac@wso2.com> wrote:
>>
>>> Hi,
>>>
>>> I'm getting the following error when running kubernetes. I'm using
>>> master branch. Is anyone expecting this before.
>>>
>>> [2015-01-12 09:27:21,782]  INFO
>>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>>  Waiting pod status to be changed to running: [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>>> [2015-01-12 09:27:26,813]  INFO
>>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>>  Waiting pod status to be changed to running: [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>>> [2015-01-12 09:27:31,834]  INFO
>>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>>  Waiting pod status to be changed to running: [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>>> [2015-01-12 09:27:36,854]  INFO
>>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>>  Waiting pod status to be changed to running: [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>>> [2015-01-12 09:27:41,882]  INFO
>>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>>  Waiting pod status to be changed to running: [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>>> [2015-01-12 09:27:41,882] ERROR
>>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>>  Pod status did not change to running within 120 sec, hence terminating
>>> member: [cluster-id] php.php.domain [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>>> [replication-controller-id]
>>> php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>>> php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>>> [2015-01-12 09:27:41,882] ERROR
>>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>>  Could not terminate container, member context not found: [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>>> [2015-01-12 09:27:41,884] ERROR
>>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>>  Could not start container: [cartridge-type] php [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>>> java.lang.IllegalArgumentException: Could not terminate container,
>>> member context not found: [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:625)
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:534)
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.waitForPodToBeActivated(KubernetesIaas.java:323)
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:216)
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startInstance(KubernetesIaas.java:115)
>>> at
>>> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.startInstance(InstanceCreator.java:102)
>>> at
>>> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.run(InstanceCreator.java:62)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:744)
>>> [2015-01-12 09:27:41,886] ERROR
>>> {org.apache.stratos.cloud.controller.services.impl.InstanceCreator} -
>>>  Could not start instance: [cartridge-type] php [cluster-id] php.php.domain
>>> java.lang.IllegalStateException: Could not start container:
>>> [cartridge-type] php [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:236)
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startInstance(KubernetesIaas.java:115)
>>> at
>>> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.startInstance(InstanceCreator.java:102)
>>> at
>>> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.run(InstanceCreator.java:62)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:744)
>>> Caused by: java.lang.IllegalArgumentException: Could not terminate
>>> container, member context not found: [member-id]
>>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:625)
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:534)
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.waitForPodToBeActivated(KubernetesIaas.java:323)
>>> at
>>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:216)
>>> ... 6 more
>>>
>>> Thanks !
>>>
>>> --
>>> Regards,
>>> Manula Chathurika Thantriwatte
>>> Software Engineer
>>> WSO2 Inc. : http://wso2.com
>>> lean . enterprise . middleware
>>>
>>> email : manulac@wso2.com / manula@apache.org
>>> phone : +94 772492511
>>> blog : http://manulachathurika.blogspot.com/
>>>
>>>
>>>
>>>
>>
>>
>> --
>> Imesh Gunaratne
>>
>> Technical Lead, WSO2
>> Committer & PMC Member, Apache Stratos
>>
>
>
>
> --
> Imesh Gunaratne
>
> Technical Lead, WSO2
> Committer & PMC Member, Apache Stratos
>



-- 
Regards,
Manula Chathurika Thantriwatte
Software Engineer
WSO2 Inc. : http://wso2.com
lean . enterprise . middleware

email : manulac@wso2.com / manula@apache.org
phone : +94 772492511
blog : http://manulachathurika.blogspot.com/

Re: Error while starting pod - from pending state to running state

Posted by Imesh Gunaratne <im...@apache.org>.
Regarding the following error:

[2015-01-12 09:27:41,884] ERROR
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Could not start container: [cartridge-type] php [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
java.lang.IllegalArgumentException: Could not terminate container, member
context not found: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015

It looks like you are running on an old codebase, now cloud controller does
not terminate the container if it didn't start properly. It is handled by
Autoscaler. Can you please verify whether you are running on the latest
build?

On Mon, Jan 12, 2015 at 10:45 PM, Imesh Gunaratne <im...@apache.org> wrote:

> Hi Manula,
>
> There seems to be a problem with your Kubernetes setup, pod status has not
> changed to Running within 120 seconds:
>
> [2015-01-12 09:27:41,882] ERROR {org.apache.stratos.cloud.
> controller.iaases.kubernetes.KubernetesIaas} -  Pod status did not change
> to running within 120 sec, hence terminating member: [cluster-id]
> php.php.domain [member-id] php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> [replication-controller-id] php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> [pod-id] php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>
> Did you pull the stratos/php:4.1.0-alpha image in the Kubernetes host
> before running the sample application? If not this error may occur as it
> would take time to pull the image for the first time.
>
> Following seems to be an issue, container termination logic has not worked
> properly:
> [2015-01-12 09:27:41,884] ERROR
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Could not start container: [cartridge-type] php [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> java.lang.IllegalArgumentException: Could not terminate container, member
> context not found: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>
> I will have a look at this.
>
> Thanks
>
> On Mon, Jan 12, 2015 at 3:01 PM, Manula Chathurika Thantriwatte <
> manulac@wso2.com> wrote:
>
>> Hi,
>>
>> I'm getting the following error when running kubernetes. I'm using master
>> branch. Is anyone expecting this before.
>>
>> [2015-01-12 09:27:21,782]  INFO
>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>  Waiting pod status to be changed to running: [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>> [2015-01-12 09:27:26,813]  INFO
>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>  Waiting pod status to be changed to running: [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>> [2015-01-12 09:27:31,834]  INFO
>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>  Waiting pod status to be changed to running: [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>> [2015-01-12 09:27:36,854]  INFO
>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>  Waiting pod status to be changed to running: [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>> [2015-01-12 09:27:41,882]  INFO
>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>  Waiting pod status to be changed to running: [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
>> [2015-01-12 09:27:41,882] ERROR
>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>  Pod status did not change to running within 120 sec, hence terminating
>> member: [cluster-id] php.php.domain [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> [replication-controller-id]
>> php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
>> php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> [2015-01-12 09:27:41,882] ERROR
>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>  Could not terminate container, member context not found: [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> [2015-01-12 09:27:41,884] ERROR
>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>  Could not start container: [cartridge-type] php [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> java.lang.IllegalArgumentException: Could not terminate container, member
>> context not found: [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:625)
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:534)
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.waitForPodToBeActivated(KubernetesIaas.java:323)
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:216)
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startInstance(KubernetesIaas.java:115)
>> at
>> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.startInstance(InstanceCreator.java:102)
>> at
>> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.run(InstanceCreator.java:62)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>> [2015-01-12 09:27:41,886] ERROR
>> {org.apache.stratos.cloud.controller.services.impl.InstanceCreator} -
>>  Could not start instance: [cartridge-type] php [cluster-id] php.php.domain
>> java.lang.IllegalStateException: Could not start container:
>> [cartridge-type] php [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:236)
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startInstance(KubernetesIaas.java:115)
>> at
>> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.startInstance(InstanceCreator.java:102)
>> at
>> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.run(InstanceCreator.java:62)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>> Caused by: java.lang.IllegalArgumentException: Could not terminate
>> container, member context not found: [member-id]
>> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:625)
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:534)
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.waitForPodToBeActivated(KubernetesIaas.java:323)
>> at
>> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:216)
>> ... 6 more
>>
>> Thanks !
>>
>> --
>> Regards,
>> Manula Chathurika Thantriwatte
>> Software Engineer
>> WSO2 Inc. : http://wso2.com
>> lean . enterprise . middleware
>>
>> email : manulac@wso2.com / manula@apache.org
>> phone : +94 772492511
>> blog : http://manulachathurika.blogspot.com/
>>
>>
>>
>>
>
>
> --
> Imesh Gunaratne
>
> Technical Lead, WSO2
> Committer & PMC Member, Apache Stratos
>



-- 
Imesh Gunaratne

Technical Lead, WSO2
Committer & PMC Member, Apache Stratos

Re: Error while starting pod - from pending state to running state

Posted by Imesh Gunaratne <im...@apache.org>.
Hi Manula,

There seems to be a problem with your Kubernetes setup, pod status has not
changed to Running within 120 seconds:

[2015-01-12 09:27:41,882] ERROR {org.apache.stratos.cloud.
controller.iaases.kubernetes.KubernetesIaas} -  Pod status did not change
to running within 120 sec, hence terminating member: [cluster-id]
php.php.domain [member-id] php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
[replication-controller-id] php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015
[pod-id] php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015

Did you pull the stratos/php:4.1.0-alpha image in the Kubernetes host
before running the sample application? If not this error may occur as it
would take time to pull the image for the first time.

Following seems to be an issue, container termination logic has not worked
properly:
[2015-01-12 09:27:41,884] ERROR
{org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
 Could not start container: [cartridge-type] php [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
java.lang.IllegalArgumentException: Could not terminate container, member
context not found: [member-id]
php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015

I will have a look at this.

Thanks

On Mon, Jan 12, 2015 at 3:01 PM, Manula Chathurika Thantriwatte <
manulac@wso2.com> wrote:

> Hi,
>
> I'm getting the following error when running kubernetes. I'm using master
> branch. Is anyone expecting this before.
>
> [2015-01-12 09:27:21,782]  INFO
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Waiting pod status to be changed to running: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
> [2015-01-12 09:27:26,813]  INFO
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Waiting pod status to be changed to running: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
> [2015-01-12 09:27:31,834]  INFO
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Waiting pod status to be changed to running: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
> [2015-01-12 09:27:36,854]  INFO
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Waiting pod status to be changed to running: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
> [2015-01-12 09:27:41,882]  INFO
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Waiting pod status to be changed to running: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
> ff128dca-9a3c-11e4-bb8e-0800278b9c8b [current-pod-status] waiting
> [2015-01-12 09:27:41,882] ERROR
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Pod status did not change to running within 120 sec, hence terminating
> member: [cluster-id] php.php.domain [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> [replication-controller-id]
> php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015 [pod-id]
> php-php-domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> [2015-01-12 09:27:41,882] ERROR
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Could not terminate container, member context not found: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> [2015-01-12 09:27:41,884] ERROR
> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>  Could not start container: [cartridge-type] php [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> java.lang.IllegalArgumentException: Could not terminate container, member
> context not found: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:625)
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:534)
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.waitForPodToBeActivated(KubernetesIaas.java:323)
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:216)
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startInstance(KubernetesIaas.java:115)
> at
> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.startInstance(InstanceCreator.java:102)
> at
> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.run(InstanceCreator.java:62)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> [2015-01-12 09:27:41,886] ERROR
> {org.apache.stratos.cloud.controller.services.impl.InstanceCreator} -
>  Could not start instance: [cartridge-type] php [cluster-id] php.php.domain
> java.lang.IllegalStateException: Could not start container:
> [cartridge-type] php [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:236)
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startInstance(KubernetesIaas.java:115)
> at
> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.startInstance(InstanceCreator.java:102)
> at
> org.apache.stratos.cloud.controller.services.impl.InstanceCreator.run(InstanceCreator.java:62)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> Caused by: java.lang.IllegalArgumentException: Could not terminate
> container, member context not found: [member-id]
> php.php.domaind57b5dbd-9e12-4315-a74f-1a1c99620015
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.handleNullObject(KubernetesIaas.java:625)
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.terminateContainer(KubernetesIaas.java:534)
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.waitForPodToBeActivated(KubernetesIaas.java:323)
> at
> org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas.startContainer(KubernetesIaas.java:216)
> ... 6 more
>
> Thanks !
>
> --
> Regards,
> Manula Chathurika Thantriwatte
> Software Engineer
> WSO2 Inc. : http://wso2.com
> lean . enterprise . middleware
>
> email : manulac@wso2.com / manula@apache.org
> phone : +94 772492511
> blog : http://manulachathurika.blogspot.com/
>
>
>
>


-- 
Imesh Gunaratne

Technical Lead, WSO2
Committer & PMC Member, Apache Stratos