You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/12/07 03:01:36 UTC
[GitHub] [dolphinscheduler] yandong001 opened a new issue, #13119: Task Execution : SQL task prepareStatementAndBind error
yandong001 opened a new issue, #13119:
URL: https://github.com/apache/dolphinscheduler/issues/13119
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
### **An error occurred during task execution**
[INFO] 2022-12-06 20:10:30.129 +0800 - can't find udf function resource
[ERROR] 2022-12-06 20:11:00.179 +0800 - execute sql error: SQL task prepareStatementAndBind error
[ERROR] 2022-12-06 20:11:00.179 +0800 - sql task error
org.apache.dolphinscheduler.plugin.task.api.TaskException: SQL task prepareStatementAndBind error
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.prepareStatementAndBind(SqlTask.java:395)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.executeUpdate(SqlTask.java:329)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.executeFuncAndSql(SqlTask.java:192)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.handle(SqlTask.java:158)
at org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread.run(TaskExecuteThread.java:208)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException: null
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.prepareStatementAndBind(SqlTask.java:381)
... 11 common frames omitted
### Check error information reported in worker logs
[ERROR] 2022-12-06 20:11:00.133 +0800 org.apache.dolphinscheduler.plugin.datasource.hive.HiveDataSourceClient:[162] - [WorkflowInstance-1287][TaskInstance-1885] - get oneSessionDataSource Connection fail SQLException: HikariPool-1 - Connection is not available, request timed out after 30059ms.
java.sql.SQLTransientConnectionException: HikariPool-1 - Connection is not available, request timed out after 30059ms.
at com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:197)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:162)
at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:128)
at org.apache.dolphinscheduler.plugin.datasource.hive.HiveDataSourceClient.getConnection(HiveDataSourceClient.java:152)
at org.apache.dolphinscheduler.plugin.datasource.api.plugin.DataSourceClientProvider.getConnection(DataSourceClientProvider.java:81)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.executeFuncAndSql(SqlTask.java:185)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.handle(SqlTask.java:158)
at org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread.run(TaskExecuteThread.java:208)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.sql.SQLTimeoutException: Query timed out after 5 seconds
at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:345)
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:251)
at com.zaxxer.hikari.pool.PoolBase.isConnectionAlive(PoolBase.java:169)
at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:186)
... 14 common frames omitted
### What you expected to happen
The /conf/application.yaml file of each service was modified. Hikari link timeout configuration did not take effect. After bin/env/dolphinscheduler_env.sh was configured, Will application.yaml file not take effect? Looks like it.
### How to reproduce
Configure hive data sources, create multiple workflows, and execute them in sequence
### Anything else
_No response_
### Version
3.0.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] DarkAssassinator commented on issue #13119: Task Execution : SQL task prepareStatementAndBind error
Posted by GitBox <gi...@apache.org>.
DarkAssassinator commented on issue #13119:
URL: https://github.com/apache/dolphinscheduler/issues/13119#issuecomment-1342720910
because system env will override yml file in Springboot
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] pijiupapa commented on issue #13119: Task Execution : SQL task prepareStatementAndBind error
Posted by "pijiupapa (via GitHub)" <gi...@apache.org>.
pijiupapa commented on issue #13119:
URL: https://github.com/apache/dolphinscheduler/issues/13119#issuecomment-1427540739
face the same problem.
When running a spark sql task and yarn hasn't enough resource to allocated, i got this error after 30s.
so i have to avoid multiple tasks running on the same time,it really confused me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Task Execution : SQL task prepareStatementAndBind error [dolphinscheduler]
Posted by "bluewaterstar (via GitHub)" <gi...@apache.org>.
bluewaterstar commented on issue #13119:
URL: https://github.com/apache/dolphinscheduler/issues/13119#issuecomment-2017123185
Is there a solution? I have the same problem
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ChewJ404 commented on issue #13119: Task Execution : SQL task prepareStatementAndBind error
Posted by GitBox <gi...@apache.org>.
ChewJ404 commented on issue #13119:
URL: https://github.com/apache/dolphinscheduler/issues/13119#issuecomment-1364427900
The same problem
version:3.1.0
`
localParams : [],udfs : ,showType : null,connParams : null,varPool : []
org.apache.dolphinscheduler.plugin.task.api.TaskException: SQL task prepareStatementAndBind error
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.prepareStatementAndBind(SqlTask.java:367)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.executeUpdate(SqlTask.java:301)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.executeFuncAndSql(SqlTask.java:200)
at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.handle(SqlTask.java:156)
Caused by: org.apache.dolphinscheduler.plugin.task.api.TaskException: SQL task prepareStatementAndBind error
Caused by: java.lang.NullPointerException: null
`
Please help me how to find the cause of parameter failure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] zhaohehuhu commented on issue #13119: Task Execution : SQL task prepareStatementAndBind error
Posted by "zhaohehuhu (via GitHub)" <gi...@apache.org>.
zhaohehuhu commented on issue #13119:
URL: https://github.com/apache/dolphinscheduler/issues/13119#issuecomment-1445814664
not working after increasing the timeout
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #13119: Task Execution : SQL task prepareStatementAndBind error
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #13119:
URL: https://github.com/apache/dolphinscheduler/issues/13119#issuecomment-1340308481
Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] yandong001 commented on issue #13119: Task Execution : SQL task prepareStatementAndBind error
Posted by GitBox <gi...@apache.org>.
yandong001 commented on issue #13119:
URL: https://github.com/apache/dolphinscheduler/issues/13119#issuecomment-1340319498
Why does the HikariPool configuration in the conf/application.yaml file not take effect
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] gzqcason commented on issue #13119: Task Execution : SQL task prepareStatementAndBind error
Posted by "gzqcason (via GitHub)" <gi...@apache.org>.
gzqcason commented on issue #13119:
URL: https://github.com/apache/dolphinscheduler/issues/13119#issuecomment-1687828420
Hey guys, I've also encountered the same problem. any good solution？ BR！
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org