You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/12/28 07:03:22 UTC
[GitHub] [dolphinscheduler] jonwjh94 opened a new issue #7671: [Bug] [task-plugin-sql] hive/impala datasource can not get connection, throw NullpointerException
jonwjh94 opened a new issue #7671:
URL: https://github.com/apache/dolphinscheduler/issues/7671
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
使用JdbcDataSourceProvider.createOneSessionJdbcDataSource()方法hive/impala创建连接池设置了MaximumPoolSize=1，但是调度任务是，一般hive/impala都是多任务同时跑的话，会出现getConnection=null的情况，因此SqlTask.prepareStatementAndBind()方法会抛出空指针异常。
### What you expected to happen
为什么hive/impala连接池需要创建容量为1的连接池？
### How to reproduce
see what happened
### Anything else
_No response_
### Version
2.0.1
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Narcasserun commented on issue #7671: [Bug] [task-plugin-sql] hive/impala datasource can not get connection, throw NullpointerException
Posted by GitBox <gi...@apache.org>.
Narcasserun commented on issue #7671:
URL: https://github.com/apache/dolphinscheduler/issues/7671#issuecomment-1001903807
You can switch the connection pool creation of multi session mode. On session is to solve the problem that the executed SQL is in the same session. It doesn't seem very friendly at the moment
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] Narcasserun commented on issue #7671: [Bug] [task-plugin-sql] hive/impala datasource can not get connection, throw NullpointerException
Posted by GitBox <gi...@apache.org>.
Narcasserun commented on issue #7671:
URL: https://github.com/apache/dolphinscheduler/issues/7671#issuecomment-1001938751
#7675
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] caishunfeng closed issue #7671: [Bug] [task-plugin-sql] hive/impala datasource can not get connection, throw NullpointerException
Posted by GitBox <gi...@apache.org>.
caishunfeng closed issue #7671:
URL: https://github.com/apache/dolphinscheduler/issues/7671
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] jonwjh94 commented on issue #7671: [Bug] [task-plugin-sql] hive/impala datasource can not get connection, throw NullpointerException
Posted by GitBox <gi...@apache.org>.
jonwjh94 commented on issue #7671:
URL: https://github.com/apache/dolphinscheduler/issues/7671#issuecomment-1004480147
Thanks for your reply! I already switch to use multi session mode.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] jonwjh94 removed a comment on issue #7671: [Bug] [task-plugin-sql] hive/impala datasource can not get connection, throw NullpointerException
Posted by GitBox <gi...@apache.org>.
jonwjh94 removed a comment on issue #7671:
URL: https://github.com/apache/dolphinscheduler/issues/7671#issuecomment-1004480147
Thanks for your reply! I already switch to use multi session mode.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #7671: [Bug] [task-plugin-sql] hive/impala datasource can not get connection, throw NullpointerException
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #7671:
URL: https://github.com/apache/dolphinscheduler/issues/7671#issuecomment-1001901876
Hi:
* Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] jonwjh94 commented on issue #7671: [Bug] [task-plugin-sql] hive/impala datasource can not get connection, throw NullpointerException
Posted by GitBox <gi...@apache.org>.
jonwjh94 commented on issue #7671:
URL: https://github.com/apache/dolphinscheduler/issues/7671#issuecomment-1004480272
> #7675
> You can switch the connection pool creation of multi session mode. On session is to solve the problem that the executed SQL is in the same session. It doesn't seem very friendly at the moment
Thanks for your reply! I already switch to use multi session mode.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #7671: [Bug] [task-plugin-sql] hive/impala datasource can not get connection, throw NullpointerException
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #7671:
URL: https://github.com/apache/dolphinscheduler/issues/7671#issuecomment-1001901772
### Search before asking
-[X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
Use JdbcDataSourceProvider.createOneSessionJdbcDataSource() method hive/impala to create the connection pool and set MaximumPoolSize=1, but the scheduling task is that generally, if hive/impala are multitasking at the same time, getConnection=null will occur, so SqlTask.prepareStatementAndBind() The method will throw a null pointer exception.
### What you expected to happen
Why does the hive/impala connection pool need to create a connection pool with a capacity of 1?
### How to reproduce
see what happened
### Anything else
_No response_
### Version
2.0.1
### Are you willing to submit PR?
-[] Yes I am willing to submit a PR!
### Code of Conduct
-[X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org