You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "lazybird23 (via GitHub)" <gi...@apache.org> on 2023/08/03 08:47:48 UTC
[GitHub] [dolphinscheduler] lazybird23 opened a new issue, #14695: spark on yarn application was successful and finished but task state is failed.
lazybird23 opened a new issue, #14695:
URL: https://github.com/apache/dolphinscheduler/issues/14695
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
task state is failed but application state was success on spark task running too much hours.
task log:
[INFO] 2023-07-31 03:32:43.102 +0800 - Remove the current task execute context from worker cache
[INFO] 2023-07-31 03:32:43.102 +0800 - The current execute mode isn't develop mode, will clear the task execute file: /tmp/dolphinscheduler/exec/process/etl/5580430270624/10381070468387_13/3237/4223
[INFO] 2023-07-31 03:32:43.114 +0800 - Success clear the task execute file: /tmp/dolphinscheduler/exec/process/etl/5580430270624/10381070468387_13/3237/4223
[INFO] 2023-07-31 03:32:43.395 +0800 - -> 23/07/31 03:32:42 INFO yarn.Client: Application report for application_1690276216665_0271 (state: FINISHED)
23/07/31 03:32:42 INFO yarn.Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: bd-prd-dn-005.deepway.local
ApplicationMaster RPC port: 8327
queue: root.users.etl
start time: 1690725415813
final status: SUCCEEDED
tracking URL: http://bd-prd-master-002.deepway.local:8088/proxy/application_1690276216665_0271/
user: etl
23/07/31 03:32:42 INFO util.ShutdownHookManager: Shutdown hook called
23/07/31 03:32:42 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-2403cdca-657c-404f-a3fb-2ab8d4e94f1f
23/07/31 03:32:42 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-1e8f2bc9-c33d-4e1c-bc5d-ea56c142817e
/tmp/dolphinscheduler/exec/process/etl/5580430270624/10381070468387_13/3237/4223/3237_4223.command:行18: journey.split.schedule.type=month: 未找到命令
[INFO] 2023-07-31 03:32:43.395 +0800 - FINALIZE_SESSION
### What you expected to happen
task state not same the application state.
### How to reproduce
spark application running too many hours this situation will be happened.
### Anything else
_No response_
### Version
3.1.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #14695: spark on yarn application was successful and finished but task state is failed.
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #14695:
URL: https://github.com/apache/dolphinscheduler/issues/14695#issuecomment-1663556601
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
task state is failed but application state was success on spark task running too much hours.
task log:
[INFO] 2023-07-31 03:32:43.102 +0800 - Remove the current task execute context from worker cache
[INFO] 2023-07-31 03:32:43.102 +0800 - The current execute mode isn't develop mode, will clear the task execute file: /tmp/dolphinscheduler/exec/process/etl/5580430270624/10381070468387_13/3237/4223
[INFO] 2023-07-31 03:32:43.114 +0800 - Success clear the task execute file: /tmp/dolphinscheduler/exec/process/etl/5580430270624/10381070468387_13/3237/4223
[INFO] 2023-07-31 03:32:43.395 +0800 - -> 23/07/31 03:32:42 INFO yarn.Client: Application report for application_1690276216665_0271 (state: FINISHED)
23/07/31 03:32:42 INFO yarn.Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: bd-prd-dn-005.deepway.local
ApplicationMaster RPC port: 8327
queue: root.users.etl
start time: 1690725415813
final status: SUCCEEDED
tracking URL: http://bd-prd-master-002.deepway.local:8088/proxy/application_1690276216665_0271/
user: etl
23/07/31 03:32:42 INFO util.ShutdownHookManager: Shutdown hook called
23/07/31 03:32:42 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-2403cdca-657c-404f-a3fb-2ab8d4e94f1f
23/07/31 03:32:42 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-1e8f2bc9-c33d-4e1c-bc5d-ea56c142817e
/tmp/dolphinscheduler/exec/process/etl/5580430270624/10381070468387_13/3237/4223/3237_4223.command:行18: journey.split.schedule.type=month: 未找到命令
[INFO] 2023-07-31 03:32:43.395 +0800 - FINALIZE_SESSION
### What you expected to happen
task state not same the application state.
### How to reproduce
spark application running too many hours this situation will be happened.
### Anything else
_No response_
### Version
3.1.x
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] lazybird23 closed issue #14695: spark on yarn application was successful and finished but task state is failed.
Posted by "lazybird23 (via GitHub)" <gi...@apache.org>.
lazybird23 closed issue #14695: spark on yarn application was successful and finished but task state is failed.
URL: https://github.com/apache/dolphinscheduler/issues/14695
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org