You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/04/27 02:06:26 UTC
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 opened a new issue #2534: [QUESTION] Log window show nothing
ZhangchengHu0923 opened a new issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534
**Describe the question**
the workflow and tasks of which excuted succesfully, but Log windows show nothing, all the tasks have this problem.
**No log shows in the Log Window**
**services look ok**
**task definition**
**workflow instance and task look ok**
**I haved checked the logs of worker service and log service, and there is no ERROR or WARN**
**Which version of DolphinScheduler:**
-[1.2.0]
**Additional context**
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
xingchun-chen commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619672612
You can check whether the path in the t_ds_task_instance.log_path has logs in the linux server
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 edited a comment on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 edited a comment on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619674937
according to the log of workerServer I found this file, and the content of which matches my task well：
/home/dolphin/dolphinscheduler/logs/7/33/60.log
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 edited a comment on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 edited a comment on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619675324
Here is the log of WorkerServer :
/tmp/dolphinscheduler/exec/process/2/7/33/60/7_33_60_node.sh
[INFO] 2020-04-27 09:53:51.779 - [taskAppId=TASK-7-33-60]:[329] - task run command:
sudo -u dolphin sh /tmp/dolphinscheduler/exec/process/2/7/33/60/7_33_60.command
[INFO] 2020-04-27 09:53:51.838 - [taskAppId=TASK-7-33-60]:[158] - process start, process id is: 4042
[INFO] 2020-04-27 09:53:51.838 - [taskAppId=TASK-7-33-60]:[168] - process has exited, work dir:/tmp/dolphinscheduler/exec/process/2/7/33/60, pid:4042 ,exitStatusCode:0
[INFO] 2020-04-27 09:53:51.846 - [taskAppId=TASK-7-33-60]:[231] - process id is 4042
[INFO] 2020-04-27 09:53:51.846 org.apache.dolphinscheduler.server.worker.runner.TaskScheduleThread:[156] - task instance id : 60,task final status : SUCCESS
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] samz406 commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
samz406 commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619694515
1 You can turn the page to query the log, and the first 1000 lines are loaded by default
2 Task organization method / tmp / dolphinscheduler / exec / process is the configuration path, followed by projectid / processDefineid / processInstanceid / taskid.
1查看日志是可以翻页查询，默认加载前1000行
2 任务的组织方式/tmp/dolphinscheduler/exec/process 是配置路径，后面依次是projectid/processDefineid/processInstanceid/taskid
如果有什么使用问题可以提交issue或者pr 😁
Have fun
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619698576
ok, thx a lot
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619670901
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619670637
the loggoerServer is already running, do I need additional operation start it ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 edited a comment on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 edited a comment on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619688923
The problem is solved, thank you for your suggestion, because the firewall of the woker machine is open.How stupid.
By the way, ask a question, if there is a task with a lot of logs, there may be 1G, or more, will there be problems that the logs can not be loaded to the web interface, then I will probably need to go to the machine to find the corresponding task, and then view Log.
But I just saw that the task organization on the machine has no relationship with the information on the web interface. It would be difficult to do this.
Tasks on the machine:
/tmp/dolphinscheduler/exec/process/2/7/33/60/7_33_60_node.sh
Web interface:
问题解决了，多谢你的建议，原因是woker机器的防火墙没有关，太蠢了，耽误您时间了，抱歉。
顺便请教一个问题，如果有个任务有很多的日志，可能有1G，或者更多，会不会出现从Web界面加载不了的问题，这时我很可能需要去机器上找到对应的任务，然后查看日志。
但是我刚才看机器上的任务组织方式和web界面上的信息没有任务关系，想做这个工作就比较困难了
机器上的任务 /tmp/dolphinscheduler/exec/process/2/7/33/60/7_33_60_node.sh
Web界面：
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
xingchun-chen commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619670026
please check if the logger server is started
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] samz406 edited a comment on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
samz406 edited a comment on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619682677
you can try like this
1 click view log in page
2 cd logs dir ,use cat * | grep logServer
<img width="867" alt="WX20200427-105143@2x" src="https://user-images.githubusercontent.com/3055810/80329497-1ac6aa80-8875-11ea-898d-a7af2896c38f.png">
3 find the host , check log path exists in the host, check the port 50051 is ok in the host.
4 check dolphinscheduler-logger-server logs, are there any errors
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619674937
according to the log of workerServerI found this file, and the content of which matches my task well：
/home/dolphin/dolphinscheduler/logs/7/33/60.log
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] samz406 commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
samz406 commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619682677
you can try like this
1 click view log in page
2 cd logs dir ,use cat * | grep logServer
<img width="867" alt="WX20200427-105143@2x" src="https://user-images.githubusercontent.com/3055810/80329497-1ac6aa80-8875-11ea-898d-a7af2896c38f.png">
3 find the host , check log path exists in the host, check the port 50051 is ok in the host.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619675324
Here is the log if WorkerServer :
/tmp/dolphinscheduler/exec/process/2/7/33/60/7_33_60_node.sh
[INFO] 2020-04-27 09:53:51.779 - [taskAppId=TASK-7-33-60]:[329] - task run command:
sudo -u dolphin sh /tmp/dolphinscheduler/exec/process/2/7/33/60/7_33_60.command
[INFO] 2020-04-27 09:53:51.838 - [taskAppId=TASK-7-33-60]:[158] - process start, process id is: 4042
[INFO] 2020-04-27 09:53:51.838 - [taskAppId=TASK-7-33-60]:[168] - process has exited, work dir:/tmp/dolphinscheduler/exec/process/2/7/33/60, pid:4042 ,exitStatusCode:0
[INFO] 2020-04-27 09:53:51.846 - [taskAppId=TASK-7-33-60]:[231] - process id is 4042
[INFO] 2020-04-27 09:53:51.846 org.apache.dolphinscheduler.server.worker.runner.TaskScheduleThread:[156] - task instance id : 60,task final status : SUCCESS
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] ZhangchengHu0923 commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
ZhangchengHu0923 commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619688923
The problem is solved, thank you for your suggestion, because the firewall of the woker machine is open.How stupid.
By the way, ask a question, if there is a task with a lot of logs, there may be 1G, or more, will there be problems that the logs can not be loaded to the web interface, then I will probably need to go to the machine to find the corresponding task, and then view Log.
But I just saw that the task organization on the machine has no relationship with the information on the web interface. It would be difficult to do this.
Tasks on the machine:
/tmp/dolphinscheduler/exec/process/2/7/33/60/7_33_60_node.sh
Web interface:
问题解决了，多谢你的建议，原因是woker机器的防火墙没有关，太蠢了，耽误您时间了，抱歉。
顺便请教一个问题，如果有个任务有很多的日志，可能有1G，或者更多，会不会出现从Web界面加载不了的问题，这时我很可能需要去机器上找到对应的任务，然后查看日志。
但是我刚才看机器上的任务组织方式和web界面上的信息没有任务关系，想做这个工作就比较困难了
机器上的任务 /tmp/dolphinscheduler/exec/process/2/7/33/60/7_33_60_node.sh
Web界面：
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] samz406 commented on issue #2534: [QUESTION] Log window show nothing
Posted by GitBox <gi...@apache.org>.
samz406 commented on issue #2534:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2534#issuecomment-619695398
> you can try like this
>
> 1 click view log in page
>
> 2 cd logs dir ,use cat * | grep logServer
> <img alt="WX20200427-105143@2x" width="867" src="https://user-images.githubusercontent.com/3055810/80329497-1ac6aa80-8875-11ea-898d-a7af2896c38f.png">
>
> 3 find the host , check log path exists in the host, check the port 50051 is ok in the host.
>
> 4 check dolphinscheduler-logger-server logs, are there any errors
before the step ,you should check the server firewall is open. ping 50051 is ok
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org