You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/10/13 04:05:09 UTC
[GitHub] [dolphinscheduler] which520 opened a new issue, #12347: [Bug] [dolphinscheduler-alert] ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream
which520 opened a new issue, #12347:
URL: https://github.com/apache/dolphinscheduler/issues/12347
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
Exception in thread "Alert-Server" org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'storageOperate' defined in class path resource [org/apache/dolphinscheduler/common/config/StoreConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.dolphinscheduler.common.storage.StorageOperate]: Factory method 'storageOperate' threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream
at org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:658)
at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:486)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1352)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1195)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:582)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:953)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:918)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:583)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:147)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:734)
### What you expected to happen
When k8s is used to deploy 3.1.0, if storagetype is set to hdfs, the alert_server will report an error
### How to reproduce
Use k8s to deploy version 3.1.0, and select hdfs as storagetype
### Anything else
_No response_
### Version
3.1.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] zhuangchong commented on issue #12347: [Bug] [dolphinscheduler-alert] ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream
Posted by GitBox <gi...@apache.org>.
zhuangchong commented on issue #12347:
URL: https://github.com/apache/dolphinscheduler/issues/12347#issuecomment-1281840441
I will close this issue, if you still have problems, you can open this issue again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] which520 commented on issue #12347: [Bug] [dolphinscheduler-alert] ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream
Posted by GitBox <gi...@apache.org>.
which520 commented on issue #12347:
URL: https://github.com/apache/dolphinscheduler/issues/12347#issuecomment-1280379330
I did not find the Hadoop-related jar package in alert-server/lib. After manually rebuilding the image and importing hadoop-common.jar, it returned to normal.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12347: [Bug] [dolphinscheduler-alert] ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #12347:
URL: https://github.com/apache/dolphinscheduler/issues/12347#issuecomment-1277001634
Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] songjianet commented on issue #12347: [Bug] [dolphinscheduler-alert] ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream
Posted by GitBox <gi...@apache.org>.
songjianet commented on issue #12347:
URL: https://github.com/apache/dolphinscheduler/issues/12347#issuecomment-1280829522
Please confirm if this issue exists in 30x and dev.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] zhuangchong commented on issue #12347: [Bug] [dolphinscheduler-alert] ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream
Posted by GitBox <gi...@apache.org>.
zhuangchong commented on issue #12347:
URL: https://github.com/apache/dolphinscheduler/issues/12347#issuecomment-1281839786
I guess you should use `HDFS` for resource configuration, you only need to configure `resource.storage.type=HDFS` in common.properties under the api-server and worker-server folders, alerter-server does not need to configure resource information, just use the default values `resource.storage.type=NONE`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] DarkAssassinator commented on issue #12347: [Bug] [dolphinscheduler-alert] ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream
Posted by GitBox <gi...@apache.org>.
DarkAssassinator commented on issue #12347:
URL: https://github.com/apache/dolphinscheduler/issues/12347#issuecomment-1279983555
did u found hadoop-common-xx.jar package in alert lib path?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] zhuangchong closed issue #12347: [Bug] [dolphinscheduler-alert] ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream
Posted by GitBox <gi...@apache.org>.
zhuangchong closed issue #12347: [Bug] [dolphinscheduler-alert] ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream
URL: https://github.com/apache/dolphinscheduler/issues/12347
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org