You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "adonis-lau (via GitHub)" <gi...@apache.org> on 2024/04/26 02:33:07 UTC
[I] [Bug] [Task] Hive SQL execution failed, but the task node shows success. [dolphinscheduler]
adonis-lau opened a new issue, #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
In the shell node, multiple SQL files are called using hive -f, and each file contains multiple SQL statements. When one of the SQL statements fails, the subsequent SQL statements continue to execute, and the status of the shell node is marked as successful.
### What you expected to happen
In the shell node, after invoking SQL via hive -f, if there are failures in the SQL execution, the subsequent SQLs should not continue to execute, and the status of the shell node should be marked as failed.
### How to reproduce
If there are 5 SQL commands in a Hive SQL file and the second command fails, the third, fourth, and fifth commands will still be executed. If these commands are executed successfully, the node will be marked as having executed successfully.
### Anything else
_No response_
### Version
3.2.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] HiveCli SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918#issuecomment-2221757352
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] HiveCli SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918#issuecomment-2138453584
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] HiveCli SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "chengcxy (via GitHub)" <gi...@apache.org>.
chengcxy commented on issue #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918#issuecomment-2143972094
> Yes, this should be a bug happens when the script contains multiple sqls, we might need to split the sql, and check each sql status after finished.
use multi shell command also need check each command status,we produced bugs in prod env
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] HiveCli SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918#issuecomment-2207634517
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] HiveCli SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "wangxj3 (via GitHub)" <gi...@apache.org>.
wangxj3 commented on issue #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918#issuecomment-2081772306
> > > Yes, this should be a bug happens when the script contains multiple sqls, we might need to split the sql, and check each sql status after finished.
> >
> >
> > The HiveCli SQL run base on shell, When build the shell ,use set -e ,could fix this ?
>
> I have not test this, but it might not fix this due to the multiple SQLS are been executed by one command, rather than multiple commands.
Oh,This doesn't look like a very good solution for one command .I will check it .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] HiveCli SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "ruanwenjun (via GitHub)" <gi...@apache.org>.
ruanwenjun commented on issue #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918#issuecomment-2081770331
> > Yes, this should be a bug happens when the script contains multiple sqls, we might need to split the sql, and check each sql status after finished.
>
> The HiveCli SQL run base on shell, When build the shell ,use set -e ,could fix this ?
I have not test this, but it might not fix this due to the multiple SQLS are been executed by one command, rather than multiple commands.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] Hive SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "ruanwenjun (via GitHub)" <gi...@apache.org>.
ruanwenjun commented on issue #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918#issuecomment-2078686166
Yes, this should be a bug, we might need to split the sql, and check each sql status after finished.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] HiveCli SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #15918: [Bug] [Task] HiveCli SQL execution failed, but the task node shows success.
URL: https://github.com/apache/dolphinscheduler/issues/15918
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] HiveCli SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "wangxj3 (via GitHub)" <gi...@apache.org>.
wangxj3 commented on issue #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918#issuecomment-2081733967
> Yes, this should be a bug happens when the script contains multiple sqls, we might need to split the sql, and check each sql status after finished.
The HiveCli SQL run base on shell, When build the shell ,use set -e ,could fix this ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Task] Hive SQL execution failed, but the task node shows success. [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #15918:
URL: https://github.com/apache/dolphinscheduler/issues/15918#issuecomment-2078530724
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
In the shell node, multiple SQL files are called using hive -f, and each file contains multiple SQL statements. When one of the SQL statements fails, the subsequent SQL statements continue to execute, and the status of the shell node is marked as successful.
### What you expected to happen
In the shell node, after invoking SQL via hive -f, if there are failures in the SQL execution, the subsequent SQLs should not continue to execute, and the status of the shell node should be marked as failed.
### How to reproduce
If there are 5 SQL commands in a Hive SQL file and the second command fails, the third, fourth, and fifth commands will still be executed. If these commands are executed successfully, the node will be marked as having executed successfully.
### Anything else
_No response_
### Version
3.2.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org