You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/10/23 03:07:10 UTC
[GitHub] [incubator-dolphinscheduler] sheldon1iu opened a new issue #3978: [Bug][Module Name] yarn application sucesssfully but dolphinscheduler spark task failed
sheldon1iu opened a new issue #3978:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3978
**Env**：
hadoop 3.2 HA namenode single yarn resource
spark 3.1
dolphinscheduler 1.3.2
postgresql 13.0 on docker
zookeeper3.6.2 on docker
xxx is my all app deploy server ip
install_config.conf :
resourceStorageType="HDFS"
defaultFS="hdfs://xxx:9000"
yarnHaIps=""
singleYarnIp="xxx"
common.properties:
yarn.resourcemanager.ha.rm.ids=
yarn.application.status.address=http://xxx:8088/ws/v1/cluster/apps/%s
**Describe the bug**
Yarn application sucesssfully but dolphinscheduler spark task failed,task logs on yarn and dolphinscheduler had no error,but dolphinscheduler exec logs which dolphinscheduler-worker.log shows connection refused to xxx:8088.
I use every user on server exec command curl --compressed -H "Accept: application/json" -X GET "http://xxx:8088/ws/v1/cluster/apps/application_1603360384142_0001",command excuted successfully and return json and json contains app key and finalstate key is olso success.I check postgresql instance table,elink column is true.I installed dolphinscheduler multitimes with different setting and I didnt create database except the trial,but the problem always exsits .Now I dont know why dolphinscheduler spark task failed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sheldon1iu commented on issue #3978: [Bug][Module Name] yarn application sucesssfully but dolphinscheduler spark task failed
Posted by GitBox <gi...@apache.org>.
sheldon1iu commented on issue #3978:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3978#issuecomment-714880760
application_1603360384142_xxx command is matched with exec-application,"001 is a example"
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sheldon1iu closed issue #3978: [Bug][Module Name] yarn application sucesssfully but dolphinscheduler spark task failed
Posted by GitBox <gi...@apache.org>.
sheldon1iu closed issue #3978:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3978
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] sheldon1iu removed a comment on issue #3978: [Bug][Module Name] yarn application sucesssfully but dolphinscheduler spark task failed
Posted by GitBox <gi...@apache.org>.
sheldon1iu removed a comment on issue #3978:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3978#issuecomment-714880760
application_1603360384142_xxx command is matched with exec-application,"001 is a example"
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org