You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/01/06 10:52:11 UTC
[GitHub] [dolphinscheduler] lishiyucn opened a new issue #7853: [Bug] spark task running status get yarn status is ok,but before finished get NullPointerException
lishiyucn opened a new issue #7853:
URL: https://github.com/apache/dolphinscheduler/issues/7853
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
dolphincheduler version 1.3.8
`[INFO] 2022-01-06 18:41:14.473 - [taskAppId=TASK-133-12856-12933]:[138] - -> 22/01/06 18:41:14 INFO Client: Application report for application_1638798534276_0813 (state: RUNNING)
[INFO] 2022-01-06 18:41:15.474 - [taskAppId=TASK-133-12856-12933]:[138] - -> 22/01/06 18:41:15 INFO Client: Application report for application_1638798534276_0813 (state: RUNNING)
[INFO] 2022-01-06 18:41:16.475 - [taskAppId=TASK-133-12856-12933]:[138] - -> 22/01/06 18:41:16 INFO Client: Application report for application_1638798534276_0813 (state: RUNNING)
[INFO] 2022-01-06 18:41:17.476 - [taskAppId=TASK-133-12856-12933]:[138] - -> 22/01/06 18:41:17 INFO Client: Application report for application_1638798534276_0813 (state: RUNNING)
[INFO] 2022-01-06 18:41:18.351 - [taskAppId=TASK-133-12856-12933]:[445] - find app id: application_1638798534276_0813
[INFO] 2022-01-06 18:41:18.351 - [taskAppId=TASK-133-12856-12933]:[402] - check yarn application status, appId:application_1638798534276_0813
[ERROR] 2022-01-06 18:41:18.354 - [taskAppId=TASK-133-12856-12933]:[418] - yarn applications: application_1638798534276_0813 , query status failed, exception:{}
java.lang.NullPointerException: null
at org.apache.dolphinscheduler.common.utils.HadoopUtils.getApplicationStatus(HadoopUtils.java:423)
at org.apache.dolphinscheduler.server.worker.task.AbstractCommandExecutor.isSuccessOfYarnState(AbstractCommandExecutor.java:404)
at org.apache.dolphinscheduler.server.worker.task.AbstractCommandExecutor.run(AbstractCommandExecutor.java:230)
at org.apache.dolphinscheduler.server.worker.task.AbstractYarnTask.handle(AbstractYarnTask.java:57)
at org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread.run(TaskExecuteThread.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[INFO] 2022-01-06 18:41:18.354 - [taskAppId=TASK-133-12856-12933]:[238] - process has exited, execute path:/tmp/dolphinscheduler/exec/process/2/133/12856/12933, processId:26205 ,exitStatusCode:-1 ,processWaitForStatus:true ,processExitValue:0`
My common.properties config is:
### What you expected to happen
for normal get yarn status util spark task successed
### How to reproduce
dolphinscheduler1.3.8
spark 2.x
### Anything else
no has others
### Version
1.3.8
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #7853: [Bug] spark task running status get yarn status is ok,but before finished get NullPointerException
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #7853:
URL: https://github.com/apache/dolphinscheduler/issues/7853#issuecomment-1006472811
Hi:
* Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org