You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Hongrong Cao (Jira)" <ji...@apache.org> on 2023/11/16 02:32:00 UTC
[jira] [Commented] (KYLIN-5708) The time range of logs included in the job diagnostic package is incomplete
[ https://issues.apache.org/jira/browse/KYLIN-5708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786577#comment-17786577 ]
Hongrong Cao commented on KYLIN-5708:
-------------------------------------
h2. Root Cause
The reason for the lack of task creation logs is the addition of TraceID to the logs, which makes it impossible for the canonical rules to get the time of the task creation logs.
!image-2023-11-16-10-27-44-668.png|width=829,height=115!
h2.
Fix Design
At the interval of generating task diagnostic package, add a regular rule which can be adapted to traceId.
The generated regular, for example, jobId is d0f45b72-db2f-407b-9d6f-7cfe6f6624e8.
h3. Before
{quote}^([0-9]\{4}-[0-9]\{2}-[0-9]\{2}T[0-9]\{2}:[0-9]\{2}:[0-9]\{2})(. *JobWorker.*jobid:d0f45b72.*)|^([0-9]\{4}-[0-9]\{2}-[0-9]\{2}T[0-9]\{2}:[0-9]\{2}:[0-9]\{2}). *d0f45b72-db2f-407b-9d6f-7cfe6f6624e8
{quote}
h3.
After
{quote}^([0-9]\{4}-[0-9]\{2}-[0-9]\{2}T[0-9]\{2}:[0-9]\{2}:[0-9]\{2}) (. *JobWorker.*jobid:d0f45b72.*)|^(traceId: ([0-9a-z]\{8}-[0-9a-z]\{4}-[0-9a-z]\{4}-[0-9a-z]\{4}-[0-9a-z]\{12}) )? ([0-9]\{4}-[0-9]\{2}-[0-9]\{2}T[0-9]\{2}:[0-9]\{2}:[0-9]\{2}). *d0f45b72-db2f-407b-9d6f-7cfe6f6624e8
{quote}
> The time range of logs included in the job diagnostic package is incomplete
> ---------------------------------------------------------------------------
>
> Key: KYLIN-5708
> URL: https://issues.apache.org/jira/browse/KYLIN-5708
> Project: Kylin
> Issue Type: Bug
> Affects Versions: 5.0-beta
> Reporter: Hongrong Cao
> Assignee: longfeiJiang
> Priority: Minor
> Fix For: 5.0.0
>
> Attachments: image-2023-11-16-10-27-44-668.png
>
>
> From the logs and job_history, we can see that the task started executing at 13:40, and the start time of schedule.log and kylin.log are both at 13:49, with no previous logs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)