You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/07/07 01:29:37 UTC
[GitHub] [dolphinscheduler] lizhongshuai opened a new issue, #10818: 不依赖hadoop的flink进行调度的错误
lizhongshuai opened a new issue, #10818:
URL: https://github.com/apache/dolphinscheduler/issues/10818
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
使用海豚调度器调度flinksql，建表语句可以正常执行，插入语句会报错
错误信息：
TaskLogLogger-class org.apache.dolphinscheduler.plugin.task.flink.FlinkTask:[63] - -> [31;1m[ERROR] Could not execute SQL statement. Reason:
java.lang.IllegalStateException: No Executor found. Please make sure to export the HADOOP_CLASSPATH environment variable or have hadoop in your classpath. For more information refer to the "Deployment" section of the official Apache Flink documentation.[0m
Shutting down the session...
done.
### What you expected to happen
写一个比较详细的flinksql调度过程 包括flink的版本 和所需要的环境
### How to reproduce
在MySQL中创建三张表 字段一致 其中两张表中插入数据 然后写flinksql 同样是创建三张一样的表 关联到mysql的表 然后查询有数据的两张表插入到第三张没有数据的表 这样的flinksql写完之后放到海豚调度器上进行调度
### Anything else
海豚调度flink是只支持on yarn部署的flink吗 kubernetes部署的是否支持调度
### Version
3.0.0-beta-2
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #10818: Scheduling error with flink that does not rely on hadoop
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #10818:
URL: https://github.com/apache/dolphinscheduler/issues/10818#issuecomment-1176952575
Dupliated with #10808.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS closed issue #10818: Scheduling error with flink that does not rely on hadoop
Posted by GitBox <gi...@apache.org>.
SbloodyS closed issue #10818: Scheduling error with flink that does not rely on hadoop
URL: https://github.com/apache/dolphinscheduler/issues/10818
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #10818: Scheduling error with flink that does not rely on hadoop
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #10818:
URL: https://github.com/apache/dolphinscheduler/issues/10818#issuecomment-1176941613
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
Use the dolphin scheduler to schedule flinksql, the table building statement can be executed normally, and the insert statement will report an error
Error message:
TaskLogLogger-class org.apache.dolphinscheduler.plugin.task.flink.FlinkTask:[63] - -> [31;1m[ERROR] Could not execute SQL statement. Reason:
java.lang.IllegalStateException: No Executor found. Please make sure to export the HADOOP_CLASSPATH environment variable or have hadoop in your classpath. For more information refer to the "Deployment" section of the official Apache Flink documentation. [0m
Shutting down the session...
done.
### What you expected to happen
Write a more detailed flinksql scheduling process, including the version of flink and the required environment
### How to reproduce
Create three tables in MySQL with the same fields, insert data into two tables, and then write flinksql. Similarly, create three identical tables and associate them with the mysql table. Then query the two tables with data and insert them into the third table without data. Such flinksql After writing, put it on the dolphin scheduler for scheduling
### Anything else
Is dolphin scheduling flink a flink that only supports on yarn deployment? Does kubernetes deployment support scheduling?
### Version
3.0.0-beta-2
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #10818: Scheduling error with flink that does not rely on hadoop
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #10818:
URL: https://github.com/apache/dolphinscheduler/issues/10818#issuecomment-1176941721
Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org