You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/10/24 06:22:19 UTC
[GitHub] [dolphinscheduler] ChewJ404 opened a new issue, #12511: [Bug] [worker] dolphinscheduler hive Default Execution Engine is mr
ChewJ404 opened a new issue, #12511:
URL: https://github.com/apache/dolphinscheduler/issues/12511
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
dolphinscheduler hive Default Execution Engine is mr
### What you expected to happen
i used hive shell to show `set hive.execution.engine`
result return
`hive.execution.engine=tez`
next i used dolphinscheduler shell hive job command
`hive -e " set hive.execution.engine"`
result return
`hive.execution.engine=mr` why???
### How to reproduce
i It's already set `hive-site.xml`
```
<property>
<name>hive.execution.engine</name>
<value>tez</value>
</property>
```
### Anything else
_No response_
### Version
3.1.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] hstdream commented on issue #12511: [Bug] [worker] dolphinscheduler hive Default Execution Engine is mr
Posted by GitBox <gi...@apache.org>.
hstdream commented on issue #12511:
URL: https://github.com/apache/dolphinscheduler/issues/12511#issuecomment-1288608670
ds:
<img width="517" alt="1666599328556" src="https://user-images.githubusercontent.com/33045461/197479718-a7e5d7fa-d060-4824-8651-4f928b1b09f9.png">
os:
<img width="573" alt="1666599312693" src="https://user-images.githubusercontent.com/33045461/197479738-79aa1c7f-f578-49dd-a336-5fd5317f9b49.png">
It has been verified that this is no problem. It is recommended to check your hive environment and whether you have restarted hiveserver2 after modifying the configuration.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ChewJ404 closed issue #12511: [Bug] [worker] dolphinscheduler hive Default Execution Engine is mr
Posted by GitBox <gi...@apache.org>.
ChewJ404 closed issue #12511: [Bug] [worker] dolphinscheduler hive Default Execution Engine is mr
URL: https://github.com/apache/dolphinscheduler/issues/12511
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ChewJ404 commented on issue #12511: [Bug] [worker] dolphinscheduler hive Default Execution Engine is mr
Posted by GitBox <gi...@apache.org>.
ChewJ404 commented on issue #12511:
URL: https://github.com/apache/dolphinscheduler/issues/12511#issuecomment-1288631126
> ds: <img alt="1666599328556" width="517" src="https://user-images.githubusercontent.com/33045461/197479718-a7e5d7fa-d060-4824-8651-4f928b1b09f9.png"> os: <img alt="1666599312693" width="573" src="https://user-images.githubusercontent.com/33045461/197479738-79aa1c7f-f578-49dd-a336-5fd5317f9b49.png"> It has been verified that this is no problem. It is recommended to check your hive environment and whether you have restarted hiveserver2 after modifying the configuration.
i test again
### hive shell
### dolphinscheduler sql task
### dolphinscheduler shell hive task
The environment variable is set and i found if used sql task i setting Customize the environment is not working
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] hstdream commented on issue #12511: [Bug] [worker] dolphinscheduler hive Default Execution Engine is mr
Posted by GitBox <gi...@apache.org>.
hstdream commented on issue #12511:
URL: https://github.com/apache/dolphinscheduler/issues/12511#issuecomment-1288545162
I'll verify this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ChewJ404 commented on issue #12511: [Bug] [worker] dolphinscheduler hive Default Execution Engine is mr
Posted by GitBox <gi...@apache.org>.
ChewJ404 commented on issue #12511:
URL: https://github.com/apache/dolphinscheduler/issues/12511#issuecomment-1288677505
The environment variable all settig is right ,i used aliyun emr ，hive shell is show right ,but on dolphinscheduler is wrong Could you give me an idea of where to find the problem
```
export HIVE_HOME=/usr/lib/hive-current
export HIVE_CONF_DIR=/etc/ecm/hive-conf
export HCAT_HOME=/usr/lib/hive-current/hcatalog
export TEZ_HOME=/usr/lib/tez-current
export TEZ_CONF_DIR=/etc/ecm/tez-conf
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] ChewJ404 commented on issue #12511: [Bug] [worker] dolphinscheduler hive Default Execution Engine is mr
Posted by GitBox <gi...@apache.org>.
ChewJ404 commented on issue #12511:
URL: https://github.com/apache/dolphinscheduler/issues/12511#issuecomment-1288717664
sorry is mine problem ,worked node is not Unified configuration
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org