You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/10/01 02:26:14 UTC
[GitHub] [dolphinscheduler] edwardhuanghz opened a new issue, #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod delpoy error
edwardhuanghz opened a new issue, #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
kubectl get po,sts,svc,cm,deploy,secret,pvc,pv -n jufund
# output
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
pod/dolphinscheduler-alert-f77d558dc-58n6m 0/1 Error 3 2m1s 10.100.242.141 cdh-02 <none> <none>
kubectl logs pod/dolphinscheduler-xx -n jufund
[WARN] 2022-10-01 10:01:22.965 +0800 org.springframework.cloud.kubernetes.fabric8.config.Fabric8ConfigMapPropertySource:[105] - Can't read configMap with name: [alert-server] in namespace: [jufund]. Ignoring.
io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: GET at: https://10.96.0.1/api/v1/namespaces/jufund/configmaps/alert-server. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. configmaps "alert-server" is forbidden: User "system:serviceaccount:jufund:default" cannot get resource "configmaps" in API group "" in the namespace "jufund".
### What you expected to happen
pod/dolphinscheduler-alert pod run ok
### How to reproduce
k8s deploy ,with self-hadoop ha env.
### Anything else
_No response_
### Version
3.1.x
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] apache-kun commented on issue #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod delpoy error
Posted by GitBox <gi...@apache.org>.
apache-kun commented on issue #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240#issuecomment-1272832208
test no use
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] xfworld commented on issue #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod deploy error
Posted by "xfworld (via GitHub)" <gi...@apache.org>.
xfworld commented on issue #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240#issuecomment-1543716601
3.0.5 currently also has this problem, more pit
***
3.0.5 目前也有这个问题，比较坑
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [k8s] pod/dolphinscheduler-alert-xx pod deploy error [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod deploy error
URL: https://github.com/apache/dolphinscheduler/issues/12240
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod delpoy error
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240#issuecomment-1264203946
Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [k8s] pod/dolphinscheduler-alert-xx pod deploy error [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240#issuecomment-1751521747
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] liqiquan commented on issue #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod delpoy error
Posted by GitBox <gi...@apache.org>.
liqiquan commented on issue #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240#issuecomment-1277219428
> I think the reason is alert-server init `StoreConfiguration`, which it doesn't need to do.
>
> You can try to remove the common properties in `templates/deployment-dolphinscheduler-alert.yaml`.
@caishunfeng
If RESOURCE_STORAGE_TYPE=HDFS is set, the master fails to operate init storageOperate:
java.lang.NoClassDefFoundError: com/amazonaws/services/s3/model/AmazonS3Exception
1. In the common module, there is init StoreConfiguration.
2. If RESOURCE_STORAGE_TYPE=HDFS, hadoop-related packages are required: hadoop-common&hadoop-client; RESOURCE_STORAGE_TYPE=S3, the jar of aws-java-sdk-s3 is required.
3. However, in the pom of the common module, hadoop-common&hadoop-client and aws-java-sdk-s3 have scope set to provided, thus losing transitionality. Therefore, if the packages that reference the common module need the hadoop and aws-java-sdk-s3 packages, they need to be added again separately.
May I ask which way will be used to solve this problem?
1. The jars of hadoops-Common&Hadoop-Client and aws-java-sdk-s3 are added separately for modules such as master and alter.
2.common module pom, scope without provided
3. StoreConfiguration is no longer init in the master and alter modules
----------------------------
如果设置RESOURCE_STORAGE_TYPE=HDFS，master也会出现init storageOperate失败：
java.lang.NoClassDefFoundError: com/amazonaws/services/s3/model/AmazonS3Exception
在common模块中，有init StoreConfiguration的操作。
如果RESOURCE_STORAGE_TYPE=HDFS，需要hadoop相关的包: hadoop-common&hadoop-client；RESOURCE_STORAGE_TYPE=S3，则需要aws-java-sdk-s3的jar。
但是在common模块的pom中，hadoop-common&hadoop-client和aws-java-sdk-s3的scope被设置为provided，失去了传递性，所以引用common模块的包如果需要hadoop和aws-java-sdk-s3包，需要单独再次添加。
请问针此问题，后面会采用那种方式解决：
1.master和alter等模块单独添加，hadoop-common&hadoop-client和aws-java-sdk-s3的jar。
2.common模块的pom中，scope去掉provided
3.master和alter等模块中不再init StoreConfiguration
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] caishunfeng commented on issue #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod delpoy error
Posted by GitBox <gi...@apache.org>.
caishunfeng commented on issue #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240#issuecomment-1272445161
I think the reason is alert-server init `StoreConfiguration`, which it doesn't need to do.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ChenpiDog commented on issue #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod delpoy error
Posted by GitBox <gi...@apache.org>.
ChenpiDog commented on issue #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240#issuecomment-1264665961
I also have this problem here. The Pod always has problems.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] lgcareer commented on issue #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod delpoy error
Posted by GitBox <gi...@apache.org>.
lgcareer commented on issue #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240#issuecomment-1272435315
@caishunfeng @ruanwenjun @chengshiwen Hi, Could you please check this issue?thx.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12240: [Bug] [k8s] pod/dolphinscheduler-alert-xx pod deploy error
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #12240:
URL: https://github.com/apache/dolphinscheduler/issues/12240#issuecomment-1741599295
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org