You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/12/28 09:59:36 UTC
[GitHub] [incubator-dolphinscheduler] suncf1985 opened a new issue #4324: SHELL 流程 cat 文件报错，请修复
suncf1985 opened a new issue #4324:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4324
文件内容如下，就是一个正常的文本文件，该 文本为hive 或MR 产生的日志文件通过shell方式调用：
Starting Job = job_1596159072514_0070, Tracking URL = http://cloudera02:8088/proxy/application_1596159072514_0070/
Kill Command = /opt/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/lib/hadoop/bin/hadoop job -kill job_1596159072514_0070
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
[root@cloudera05 demo1]# vi tt.txt
S22121tarting Job = job_1596159072514_0070, Tracking URL = http://cloudera02:8088/proxy/application_1596159072514_0070/
Kill Command = /opt/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/lib/hadoop/bin/hadoop job -kill job_1596159072514_0070
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
shell流程中输入如下:
此时,运行此shell节点,会以失败返回。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] suncf1985 commented on issue #4324: SHELL process cat file report error, please fix
Posted by GitBox <gi...@apache.org>.
suncf1985 commented on issue #4324:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4324#issuecomment-751983090
> Because the text words with “application_*”，The worker scan the output of the task, if the application id matched, then try to get yarn application state
> 
这个需要修改源码解决吗?这应该是一个BUG吧.hive或MR的日志都带这样的日志
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] CalvinKirs commented on issue #4324: SHELL 流程 cat 文件报错，请修复
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #4324:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4324#issuecomment-751681393
For better global communication, Please describe it in English. If you feel the description in English is not clear, then you can append description in Chinese(just for Mandarin(CN)), thx!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] suncf1985 commented on issue #4324: SHELL 流程 cat 文件报错，请修复
Posted by GitBox <gi...@apache.org>.
suncf1985 commented on issue #4324:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4324#issuecomment-751701042
SHELL process cat file report error, please fix
When you use the cat command to view the text content, the content includes the following content, then the node is an error node, and it has nothing to do with the process at this time. Please verify
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] suncf1985 commented on issue #4324: SHELL process cat file report error, please fix
Posted by GitBox <gi...@apache.org>.
suncf1985 commented on issue #4324:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4324#issuecomment-751911043
Starting Job = job_1596159072514_0070, Tracking URL = http://cloudera02:8088/proxy/application_1596159072514_0070/
Kill Command = /opt/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/lib/hadoop/bin/hadoop job -kill job_1596159072514_0070
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] zhanguohao commented on issue #4324: SHELL process cat file report error, please fix
Posted by GitBox <gi...@apache.org>.
zhanguohao commented on issue #4324:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4324#issuecomment-751983892
> > Because the text words with “application_*”，The worker scan the output of the task, if the application id matched, then try to get yarn application state
> > 
>
> 这个需要修改源码解决吗?这应该是一个BUG吧.hive或MR的日志都带这样的日志
It need to modify the source code.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] zhanguohao commented on issue #4324: SHELL process cat file report error, please fix
Posted by GitBox <gi...@apache.org>.
zhanguohao commented on issue #4324:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4324#issuecomment-751981984
Because the text words with “application_*”，The worker scan the output of the task, if the application id matched, then try to get yarn application state
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org