You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@rocketmq.apache.org by "huaibaowu (via GitHub)" <gi...@apache.org> on 2023/03/17 07:24:27 UTC

[GitHub] [rocketmq-operator] huaibaowu opened a new issue, #153: why operator pod restarts several times

huaibaowu opened a new issue, #153:
URL: https://github.com/apache/rocketmq-operator/issues/153

   We deploy RocketMQ in k8s in gcloud and find the operator pod has restarted several times. We don't know why.
   
   ![image](https://user-images.githubusercontent.com/115698164/225838565-58924f3d-c3f7-4543-a7d0-124b484ad704.png)
   ![image](https://user-images.githubusercontent.com/115698164/225838985-07339342-376f-45cb-a9c1-01e7994c9099.png)
   ![image](https://user-images.githubusercontent.com/115698164/225839331-da38abfc-488b-4497-818f-afa35277b968.png)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] why operator pod restarts several times [rocketmq-operator]

Posted by "RockteMQ-AI (via GitHub)" <gi...@apache.org>.

RockteMQ-AI commented on issue #153:
URL: https://github.com/apache/rocketmq-operator/issues/153#issuecomment-5216292961

   **Issue Evaluation**
   
   Category: `question` | Status: **Answered**
   
   Operator pod restarts are typically caused by:
   
   1. **Liveness/Readiness probe failures** — If the operator takes too long to reconcile resources, the liveness probe may time out. Check probe configuration: `kubectl describe pod <operator-pod>`.
   2. **OOM (Out of Memory)** — The operator may be consuming too much memory during reconciliation of large clusters. Check resource limits and increase if needed.
   3. **Leader election** — If running multiple replicas, leader election timeouts can cause restarts. Check logs for `leader election lost` messages.
   4. **Webhook failures** — If the operator serves admission webhooks and the webhook service is slow, the pod may be killed.
   
   Check the restart reason:
   ```bash
   kubectl describe pod <operator-pod> | grep -A5 "Last State"
   ```
   
   ---
   *Automated evaluation by @RockteMQ-AI*
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq-operator] caigy commented on issue #153: why operator pod restarts several times

Posted by "caigy (via GitHub)" <gi...@apache.org>.

caigy commented on issue #153:
URL: https://github.com/apache/rocketmq-operator/issues/153#issuecomment-1477182680

   Please run `kubectl describe po {YOUR_POD_NAME}` to check if any error events. Also run `kubectl logs {YOUR_POD_NAME}` to find if there're any error messages.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org