You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by li...@apache.org on 2026/05/14 07:02:29 UTC
(doris-website) branch master updated: [doc](load) add field examples and troubleshooting query for routine_load_job (#3635)
This is an automated email from the ASF dual-hosted git repository.
liaoxin01 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new 069d354b7ca [doc](load) add field examples and troubleshooting query for routine_load_job (#3635)
069d354b7ca is described below
commit 069d354b7ca6d56177f4daef6d83c1d24beef889
Author: hui lai <13...@qq.com>
AuthorDate: Thu May 14 15:02:23 2026 +0800
[doc](load) add field examples and troubleshooting query for routine_load_job (#3635)
---
.../information_schema/routine_load_job.md | 77 +++++++++++++-------
.../information_schema/routine_load_job.md | 77 +++++++++++++-------
.../information_schema/routine_load_job.md | 77 +++++++++++++-------
.../information_schema/routine_load_job.md | 77 +++++++++++++-------
.../information_schema/routine_load_job.md | 81 +++++++++++++++-------
.../information_schema/routine_load_job.md | 77 +++++++++++++-------
.../information_schema/routine_load_job.md | 77 +++++++++++++-------
.../information_schema/routine_load_job.md | 81 +++++++++++++++-------
.../information_schema/routine_load_job.md | 81 +++++++++++++++-------
.../information_schema/routine_load_job.md | 81 +++++++++++++++-------
.../information_schema/routine_load_job.md | 77 +++++++++++++-------
11 files changed, 591 insertions(+), 272 deletions(-)
diff --git a/docs-next/admin-manual/system-tables/information_schema/routine_load_job.md b/docs-next/admin-manual/system-tables/information_schema/routine_load_job.md
index f35b0ee1955..8acc853f73b 100644
--- a/docs-next/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/docs-next/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -10,31 +10,60 @@
Used to view information about routine load jobs.
-## Database
+## Database and Table
-`information_schema`
+`information_schema.routine_load_jobs`
## Table Information
-| Column Name | Type | Description |
-| :-------------------- | :-------- | :----------------------------------------- |
-| JOB_ID | text | Job ID |
-| JOB_NAME | text | Job name |
-| CREATE_TIME | text | Job creation time |
-| PAUSE_TIME | text | Job pause time |
-| END_TIME | text | Job end time |
-| DB_NAME | text | Database name |
-| TABLE_NAME | text | Table name |
-| STATE | text | Job status |
-| CURRENT_TASK_NUM | text | Current number of subtasks |
-| JOB_PROPERTIES | text | Job property configurations |
-| DATA_SOURCE_PROPERTIES| text | Data source property configurations |
-| CUSTOM_PROPERTIES | text | Custom property configurations |
-| STATISTIC | text | Job statistics information |
-| PROGRESS | text | Job progress information |
-| LAG | text | Job delay information |
-| REASON_OF_STATE_CHANGED| text | Reason for job status change |
-| ERROR_LOG_URLS | text | Error log URLs |
-| USER_NAME | text | Username |
-| CURRENT_ABORT_TASK_NUM| int | Current number of failed tasks |
-| IS_ABNORMAL_PAUSE | boolean | Whether paused by system (non-user pause) |
\ No newline at end of file
+| Column Name | Type | Description | Example |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :------ |
+| JOB_ID | text | Job ID generated by Doris. | `12025` |
+| JOB_NAME | text | Routine Load job name. | `example_routine_load` |
+| CREATE_TIME | text | Job creation time. | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | Most recent job pause time. It is `NULL` if the job has not been paused. | `NULL` |
+| END_TIME | text | Job end time. It is `NULL` if the job has not ended. | `NULL` |
+| DB_NAME | text | Database name of the job. | `default_cluster:testdb` |
+| TABLE_NAME | text | Target table name of the job. For multi-table import jobs, this value is `multi-table`. | `test_routineload_tbl` |
+| STATE | text | Job running status, including `NEED_SCHEDULE`, `RUNNING`, `PAUSED`, `STOPPED`, and `CANCELLED`. | `RUNNING` |
+| CURRENT_TASK_NUM | text | Number of subtasks currently being scheduled or executed. | `1` |
+| JOB_PROPERTIES | text | Job property configurations, including batch size, concurrency, import format, column mapping, and error tolerance. | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | Data source property configurations. For Kafka, this includes topic, broker list, and current Kafka partitions. | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | Custom properties configured when creating the job. For Kafka, this usually includes offsets, group id, and Kafka client parameters passed with `property.` prefixes. | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | Job runtime statistics. Common fields include `receivedBytes`, `loadedRows`, `errorRows`, `committedTaskNum`, `abortedTaskNum`, `loadRowsRate`, and `taskExecuteTimeMs`. | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | Job running progress. For Kafka, it shows the consumed offset of each partition. | `{"0":"2"}` |
+| LAG | text | Job lag information. For Kafka, it shows the consumption lag of each partition. | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | Reason for the job state change. It is usually empty for normally running jobs, and records the specific reason when the job is paused or cancelled abnormally. | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | Error log URLs for viewing filtered data that failed quality checks. It is empty if there is no error log. | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | User who created or operated the job. | `root` |
+| CURRENT_ABORT_TASK_NUM | int | Current number of failed subtasks. | `0` |
+| IS_ABNORMAL_PAUSE | boolean | Whether the job was paused abnormally by the system instead of manually by a user. `true` indicates an abnormal system pause, and `false` indicates no abnormal pause. | `false` |
+
+## Query Abnormal Jobs
+
+If a job is abnormally paused, has failed tasks, or is in the `RUNNING` state but has no running subtasks while Kafka still has consumption lag, it should be investigated. You can use the following SQL to query these jobs:
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+After finding an abnormal job, switch to the corresponding database and use `SHOW ROUTINE LOAD` to view the job details:
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+`LAG` is the Kafka consumption lag information for each partition. `LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` matches jobs where at least one partition has a lag greater than 0.
diff --git a/docs/admin-manual/system-tables/information_schema/routine_load_job.md b/docs/admin-manual/system-tables/information_schema/routine_load_job.md
index f35b0ee1955..8acc853f73b 100644
--- a/docs/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/docs/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -10,31 +10,60 @@
Used to view information about routine load jobs.
-## Database
+## Database and Table
-`information_schema`
+`information_schema.routine_load_jobs`
## Table Information
-| Column Name | Type | Description |
-| :-------------------- | :-------- | :----------------------------------------- |
-| JOB_ID | text | Job ID |
-| JOB_NAME | text | Job name |
-| CREATE_TIME | text | Job creation time |
-| PAUSE_TIME | text | Job pause time |
-| END_TIME | text | Job end time |
-| DB_NAME | text | Database name |
-| TABLE_NAME | text | Table name |
-| STATE | text | Job status |
-| CURRENT_TASK_NUM | text | Current number of subtasks |
-| JOB_PROPERTIES | text | Job property configurations |
-| DATA_SOURCE_PROPERTIES| text | Data source property configurations |
-| CUSTOM_PROPERTIES | text | Custom property configurations |
-| STATISTIC | text | Job statistics information |
-| PROGRESS | text | Job progress information |
-| LAG | text | Job delay information |
-| REASON_OF_STATE_CHANGED| text | Reason for job status change |
-| ERROR_LOG_URLS | text | Error log URLs |
-| USER_NAME | text | Username |
-| CURRENT_ABORT_TASK_NUM| int | Current number of failed tasks |
-| IS_ABNORMAL_PAUSE | boolean | Whether paused by system (non-user pause) |
\ No newline at end of file
+| Column Name | Type | Description | Example |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :------ |
+| JOB_ID | text | Job ID generated by Doris. | `12025` |
+| JOB_NAME | text | Routine Load job name. | `example_routine_load` |
+| CREATE_TIME | text | Job creation time. | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | Most recent job pause time. It is `NULL` if the job has not been paused. | `NULL` |
+| END_TIME | text | Job end time. It is `NULL` if the job has not ended. | `NULL` |
+| DB_NAME | text | Database name of the job. | `default_cluster:testdb` |
+| TABLE_NAME | text | Target table name of the job. For multi-table import jobs, this value is `multi-table`. | `test_routineload_tbl` |
+| STATE | text | Job running status, including `NEED_SCHEDULE`, `RUNNING`, `PAUSED`, `STOPPED`, and `CANCELLED`. | `RUNNING` |
+| CURRENT_TASK_NUM | text | Number of subtasks currently being scheduled or executed. | `1` |
+| JOB_PROPERTIES | text | Job property configurations, including batch size, concurrency, import format, column mapping, and error tolerance. | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | Data source property configurations. For Kafka, this includes topic, broker list, and current Kafka partitions. | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | Custom properties configured when creating the job. For Kafka, this usually includes offsets, group id, and Kafka client parameters passed with `property.` prefixes. | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | Job runtime statistics. Common fields include `receivedBytes`, `loadedRows`, `errorRows`, `committedTaskNum`, `abortedTaskNum`, `loadRowsRate`, and `taskExecuteTimeMs`. | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | Job running progress. For Kafka, it shows the consumed offset of each partition. | `{"0":"2"}` |
+| LAG | text | Job lag information. For Kafka, it shows the consumption lag of each partition. | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | Reason for the job state change. It is usually empty for normally running jobs, and records the specific reason when the job is paused or cancelled abnormally. | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | Error log URLs for viewing filtered data that failed quality checks. It is empty if there is no error log. | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | User who created or operated the job. | `root` |
+| CURRENT_ABORT_TASK_NUM | int | Current number of failed subtasks. | `0` |
+| IS_ABNORMAL_PAUSE | boolean | Whether the job was paused abnormally by the system instead of manually by a user. `true` indicates an abnormal system pause, and `false` indicates no abnormal pause. | `false` |
+
+## Query Abnormal Jobs
+
+If a job is abnormally paused, has failed tasks, or is in the `RUNNING` state but has no running subtasks while Kafka still has consumption lag, it should be investigated. You can use the following SQL to query these jobs:
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+After finding an abnormal job, switch to the corresponding database and use `SHOW ROUTINE LOAD` to view the job details:
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+`LAG` is the Kafka consumption lag information for each partition. `LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` matches jobs where at least one partition has a lag greater than 0.
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs-next/current/admin-manual/system-tables/information_schema/routine_load_job.md b/i18n/zh-CN/docusaurus-plugin-content-docs-next/current/admin-manual/system-tables/information_schema/routine_load_job.md
index 019b45f01cf..3b85ae2a2c0 100644
--- a/i18n/zh-CN/docusaurus-plugin-content-docs-next/current/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs-next/current/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -10,31 +10,60 @@
用于查看routine load导入作业的信息
-## 所属数据库
+## 所属数据库和表
-`information_schema`
+`information_schema.routine_load_jobs`
## 表信息
-| 列名 | 类型 | 说明 |
-| :--------------------- | :-------- | :-------------------------------------- |
-| JOB_ID | text | 作业 ID |
-| JOB_NAME | text | 作业名称 |
-| CREATE_TIME | text | 作业创建时间 |
-| PAUSE_TIME | text | 作业暂停时间 |
-| END_TIME | text | 作业结束时间 |
-| DB_NAME | text | 数据库名称 |
-| TABLE_NAME | text | 表名称 |
-| STATE | text | 作业状态 |
-| CURRENT_TASK_NUM | text | 当前子任务数量 |
-| JOB_PROPERTIES | text | 作业属性配置 |
-| DATA_SOURCE_PROPERTIES | text | 数据源属性配置 |
-| CUSTOM_PROPERTIES | text | 自定义属性配置 |
-| STATISTIC | text | 作业统计信息 |
-| PROGRESS | text | 作业进度信息 |
-| LAG | text | 作业延迟信息 |
-| REASON_OF_STATE_CHANGED| text | 作业状态变更原因 |
-| ERROR_LOG_URLS | text | 错误日志 URL |
-| USER_NAME | text | 用户名 |
-| CURRENT_ABORT_TASK_NUM | int | 当前失败的任务数量 |
-| IS_ABNORMAL_PAUSE | boolean | 是否非用户暂停 |
+| 列名 | 类型 | 说明 | 样例 |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :--- |
+| JOB_ID | text | 作业 ID，由 Doris 自动生成。 | `12025` |
+| JOB_NAME | text | Routine Load 作业名称。 | `example_routine_load` |
+| CREATE_TIME | text | 作业创建时间。 | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | 最近一次作业暂停时间。作业未暂停时为 `NULL`。 | `NULL` |
+| END_TIME | text | 作业结束时间。作业未结束时为 `NULL`。 | `NULL` |
+| DB_NAME | text | 作业所属数据库名称。 | `default_cluster:testdb` |
+| TABLE_NAME | text | 作业导入的目标表名称。多表导入时显示为 `multi-table`。 | `test_routineload_tbl` |
+| STATE | text | 作业运行状态，包括 `NEED_SCHEDULE`、`RUNNING`、`PAUSED`、`STOPPED`、`CANCELLED`。 | `RUNNING` |
+| CURRENT_TASK_NUM | text | 当前正在调度或执行的子任务数量。 | `1` |
+| JOB_PROPERTIES | text | 作业属性配置，包含批次大小、并发数、导入格式、列映射、错误容忍度等配置。 | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | 数据源属性配置。Kafka 数据源中包含 topic、broker 列表和当前 Kafka 分区等信息。 | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | 创建作业时设置的自定义属性。Kafka 数据源中通常包含消费 offset、group id 以及以 `property.` 前缀传入的 Kafka 客户端参数。 | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | 作业运行统计信息。常用字段包括 `receivedBytes`、`loadedRows`、`errorRows`、`committedTaskNum`、`abortedTaskNum`、`loadRowsRate`、`taskExecuteTimeMs` 等。 | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | 作业运行进度。Kafka 数据源中显示每个分区当前已消费的 offset。 | `{"0":"2"}` |
+| LAG | text | 作业延迟信息。Kafka 数据源中显示每个分区的消费积压量。 | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | 作业状态变更原因。正常运行时通常为空；异常暂停或取消时记录具体原因。 | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | 错误日志 URL，用于查看被过滤的质量不合格数据。无错误日志时为空。 | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | 创建或操作该作业的用户。 | `root` |
+| CURRENT_ABORT_TASK_NUM | int | 当前失败的子任务数量。 | `0` |
+| IS_ABNORMAL_PAUSE | boolean | 是否为非用户手动触发的异常暂停。`true` 表示系统因异常原因暂停作业，`false` 表示没有异常暂停。 | `false` |
+
+## 查询异常作业
+
+如果作业异常暂停、存在失败任务，或处于 `RUNNING` 状态但没有正在执行的子任务，同时 Kafka 仍有消费积压，都可以视为需要进一步排查的异常作业。可以通过以下 SQL 查询这些作业：
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+查询到异常作业后，可以切换到对应数据库，通过 `SHOW ROUTINE LOAD` 查看作业详情：
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+其中 `LAG` 是 Kafka 各分区的消费积压信息。`LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` 用于匹配至少有一个分区存在大于 0 的积压。
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/system-tables/information_schema/routine_load_job.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/system-tables/information_schema/routine_load_job.md
index 019b45f01cf..3b85ae2a2c0 100644
--- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -10,31 +10,60 @@
用于查看routine load导入作业的信息
-## 所属数据库
+## 所属数据库和表
-`information_schema`
+`information_schema.routine_load_jobs`
## 表信息
-| 列名 | 类型 | 说明 |
-| :--------------------- | :-------- | :-------------------------------------- |
-| JOB_ID | text | 作业 ID |
-| JOB_NAME | text | 作业名称 |
-| CREATE_TIME | text | 作业创建时间 |
-| PAUSE_TIME | text | 作业暂停时间 |
-| END_TIME | text | 作业结束时间 |
-| DB_NAME | text | 数据库名称 |
-| TABLE_NAME | text | 表名称 |
-| STATE | text | 作业状态 |
-| CURRENT_TASK_NUM | text | 当前子任务数量 |
-| JOB_PROPERTIES | text | 作业属性配置 |
-| DATA_SOURCE_PROPERTIES | text | 数据源属性配置 |
-| CUSTOM_PROPERTIES | text | 自定义属性配置 |
-| STATISTIC | text | 作业统计信息 |
-| PROGRESS | text | 作业进度信息 |
-| LAG | text | 作业延迟信息 |
-| REASON_OF_STATE_CHANGED| text | 作业状态变更原因 |
-| ERROR_LOG_URLS | text | 错误日志 URL |
-| USER_NAME | text | 用户名 |
-| CURRENT_ABORT_TASK_NUM | int | 当前失败的任务数量 |
-| IS_ABNORMAL_PAUSE | boolean | 是否非用户暂停 |
+| 列名 | 类型 | 说明 | 样例 |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :--- |
+| JOB_ID | text | 作业 ID，由 Doris 自动生成。 | `12025` |
+| JOB_NAME | text | Routine Load 作业名称。 | `example_routine_load` |
+| CREATE_TIME | text | 作业创建时间。 | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | 最近一次作业暂停时间。作业未暂停时为 `NULL`。 | `NULL` |
+| END_TIME | text | 作业结束时间。作业未结束时为 `NULL`。 | `NULL` |
+| DB_NAME | text | 作业所属数据库名称。 | `default_cluster:testdb` |
+| TABLE_NAME | text | 作业导入的目标表名称。多表导入时显示为 `multi-table`。 | `test_routineload_tbl` |
+| STATE | text | 作业运行状态，包括 `NEED_SCHEDULE`、`RUNNING`、`PAUSED`、`STOPPED`、`CANCELLED`。 | `RUNNING` |
+| CURRENT_TASK_NUM | text | 当前正在调度或执行的子任务数量。 | `1` |
+| JOB_PROPERTIES | text | 作业属性配置，包含批次大小、并发数、导入格式、列映射、错误容忍度等配置。 | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | 数据源属性配置。Kafka 数据源中包含 topic、broker 列表和当前 Kafka 分区等信息。 | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | 创建作业时设置的自定义属性。Kafka 数据源中通常包含消费 offset、group id 以及以 `property.` 前缀传入的 Kafka 客户端参数。 | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | 作业运行统计信息。常用字段包括 `receivedBytes`、`loadedRows`、`errorRows`、`committedTaskNum`、`abortedTaskNum`、`loadRowsRate`、`taskExecuteTimeMs` 等。 | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | 作业运行进度。Kafka 数据源中显示每个分区当前已消费的 offset。 | `{"0":"2"}` |
+| LAG | text | 作业延迟信息。Kafka 数据源中显示每个分区的消费积压量。 | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | 作业状态变更原因。正常运行时通常为空；异常暂停或取消时记录具体原因。 | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | 错误日志 URL，用于查看被过滤的质量不合格数据。无错误日志时为空。 | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | 创建或操作该作业的用户。 | `root` |
+| CURRENT_ABORT_TASK_NUM | int | 当前失败的子任务数量。 | `0` |
+| IS_ABNORMAL_PAUSE | boolean | 是否为非用户手动触发的异常暂停。`true` 表示系统因异常原因暂停作业，`false` 表示没有异常暂停。 | `false` |
+
+## 查询异常作业
+
+如果作业异常暂停、存在失败任务，或处于 `RUNNING` 状态但没有正在执行的子任务，同时 Kafka 仍有消费积压，都可以视为需要进一步排查的异常作业。可以通过以下 SQL 查询这些作业：
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+查询到异常作业后，可以切换到对应数据库，通过 `SHOW ROUTINE LOAD` 查看作业详情：
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+其中 `LAG` 是 Kafka 各分区的消费积压信息。`LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` 用于匹配至少有一个分区存在大于 0 的积压。
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md
index 2ff10f68f49..3b85ae2a2c0 100644
--- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -2,39 +2,68 @@
{
"title": "routine_load_job",
"language": "zh-CN",
- "description": "用于查看routine load导入作业的信息, 从3.0.5版本引入这个特性。"
+ "description": "用于查看routine load导入作业的信息"
}
---
## 概述
-用于查看routine load导入作业的信息, 从3.0.5版本引入这个特性。
+用于查看routine load导入作业的信息
-## 所属数据库
+## 所属数据库和表
-`information_schema`
+`information_schema.routine_load_jobs`
## 表信息
-| 列名 | 类型 | 说明 |
-| :--------------------- | :-------- | :-------------------------------------- |
-| JOB_ID | text | 作业 ID |
-| JOB_NAME | text | 作业名称 |
-| CREATE_TIME | text | 作业创建时间 |
-| PAUSE_TIME | text | 作业暂停时间 |
-| END_TIME | text | 作业结束时间 |
-| DB_NAME | text | 数据库名称 |
-| TABLE_NAME | text | 表名称 |
-| STATE | text | 作业状态 |
-| CURRENT_TASK_NUM | text | 当前子任务数量 |
-| JOB_PROPERTIES | text | 作业属性配置 |
-| DATA_SOURCE_PROPERTIES | text | 数据源属性配置 |
-| CUSTOM_PROPERTIES | text | 自定义属性配置 |
-| STATISTIC | text | 作业统计信息 |
-| PROGRESS | text | 作业进度信息 |
-| LAG | text | 作业延迟信息 |
-| REASON_OF_STATE_CHANGED| text | 作业状态变更原因 |
-| ERROR_LOG_URLS | text | 错误日志 URL |
-| USER_NAME | text | 用户名 |
-| CURRENT_ABORT_TASK_NUM | int | 当前失败的任务数量 |
-| IS_ABNORMAL_PAUSE | boolean | 是否非用户暂停 |
+| 列名 | 类型 | 说明 | 样例 |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :--- |
+| JOB_ID | text | 作业 ID，由 Doris 自动生成。 | `12025` |
+| JOB_NAME | text | Routine Load 作业名称。 | `example_routine_load` |
+| CREATE_TIME | text | 作业创建时间。 | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | 最近一次作业暂停时间。作业未暂停时为 `NULL`。 | `NULL` |
+| END_TIME | text | 作业结束时间。作业未结束时为 `NULL`。 | `NULL` |
+| DB_NAME | text | 作业所属数据库名称。 | `default_cluster:testdb` |
+| TABLE_NAME | text | 作业导入的目标表名称。多表导入时显示为 `multi-table`。 | `test_routineload_tbl` |
+| STATE | text | 作业运行状态，包括 `NEED_SCHEDULE`、`RUNNING`、`PAUSED`、`STOPPED`、`CANCELLED`。 | `RUNNING` |
+| CURRENT_TASK_NUM | text | 当前正在调度或执行的子任务数量。 | `1` |
+| JOB_PROPERTIES | text | 作业属性配置，包含批次大小、并发数、导入格式、列映射、错误容忍度等配置。 | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | 数据源属性配置。Kafka 数据源中包含 topic、broker 列表和当前 Kafka 分区等信息。 | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | 创建作业时设置的自定义属性。Kafka 数据源中通常包含消费 offset、group id 以及以 `property.` 前缀传入的 Kafka 客户端参数。 | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | 作业运行统计信息。常用字段包括 `receivedBytes`、`loadedRows`、`errorRows`、`committedTaskNum`、`abortedTaskNum`、`loadRowsRate`、`taskExecuteTimeMs` 等。 | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | 作业运行进度。Kafka 数据源中显示每个分区当前已消费的 offset。 | `{"0":"2"}` |
+| LAG | text | 作业延迟信息。Kafka 数据源中显示每个分区的消费积压量。 | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | 作业状态变更原因。正常运行时通常为空；异常暂停或取消时记录具体原因。 | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | 错误日志 URL，用于查看被过滤的质量不合格数据。无错误日志时为空。 | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | 创建或操作该作业的用户。 | `root` |
+| CURRENT_ABORT_TASK_NUM | int | 当前失败的子任务数量。 | `0` |
+| IS_ABNORMAL_PAUSE | boolean | 是否为非用户手动触发的异常暂停。`true` 表示系统因异常原因暂停作业，`false` 表示没有异常暂停。 | `false` |
+
+## 查询异常作业
+
+如果作业异常暂停、存在失败任务，或处于 `RUNNING` 状态但没有正在执行的子任务，同时 Kafka 仍有消费积压，都可以视为需要进一步排查的异常作业。可以通过以下 SQL 查询这些作业：
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+查询到异常作业后，可以切换到对应数据库，通过 `SHOW ROUTINE LOAD` 查看作业详情：
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+其中 `LAG` 是 Kafka 各分区的消费积压信息。`LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` 用于匹配至少有一个分区存在大于 0 的积压。
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md
index 019b45f01cf..3b85ae2a2c0 100644
--- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -10,31 +10,60 @@
用于查看routine load导入作业的信息
-## 所属数据库
+## 所属数据库和表
-`information_schema`
+`information_schema.routine_load_jobs`
## 表信息
-| 列名 | 类型 | 说明 |
-| :--------------------- | :-------- | :-------------------------------------- |
-| JOB_ID | text | 作业 ID |
-| JOB_NAME | text | 作业名称 |
-| CREATE_TIME | text | 作业创建时间 |
-| PAUSE_TIME | text | 作业暂停时间 |
-| END_TIME | text | 作业结束时间 |
-| DB_NAME | text | 数据库名称 |
-| TABLE_NAME | text | 表名称 |
-| STATE | text | 作业状态 |
-| CURRENT_TASK_NUM | text | 当前子任务数量 |
-| JOB_PROPERTIES | text | 作业属性配置 |
-| DATA_SOURCE_PROPERTIES | text | 数据源属性配置 |
-| CUSTOM_PROPERTIES | text | 自定义属性配置 |
-| STATISTIC | text | 作业统计信息 |
-| PROGRESS | text | 作业进度信息 |
-| LAG | text | 作业延迟信息 |
-| REASON_OF_STATE_CHANGED| text | 作业状态变更原因 |
-| ERROR_LOG_URLS | text | 错误日志 URL |
-| USER_NAME | text | 用户名 |
-| CURRENT_ABORT_TASK_NUM | int | 当前失败的任务数量 |
-| IS_ABNORMAL_PAUSE | boolean | 是否非用户暂停 |
+| 列名 | 类型 | 说明 | 样例 |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :--- |
+| JOB_ID | text | 作业 ID，由 Doris 自动生成。 | `12025` |
+| JOB_NAME | text | Routine Load 作业名称。 | `example_routine_load` |
+| CREATE_TIME | text | 作业创建时间。 | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | 最近一次作业暂停时间。作业未暂停时为 `NULL`。 | `NULL` |
+| END_TIME | text | 作业结束时间。作业未结束时为 `NULL`。 | `NULL` |
+| DB_NAME | text | 作业所属数据库名称。 | `default_cluster:testdb` |
+| TABLE_NAME | text | 作业导入的目标表名称。多表导入时显示为 `multi-table`。 | `test_routineload_tbl` |
+| STATE | text | 作业运行状态，包括 `NEED_SCHEDULE`、`RUNNING`、`PAUSED`、`STOPPED`、`CANCELLED`。 | `RUNNING` |
+| CURRENT_TASK_NUM | text | 当前正在调度或执行的子任务数量。 | `1` |
+| JOB_PROPERTIES | text | 作业属性配置，包含批次大小、并发数、导入格式、列映射、错误容忍度等配置。 | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | 数据源属性配置。Kafka 数据源中包含 topic、broker 列表和当前 Kafka 分区等信息。 | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | 创建作业时设置的自定义属性。Kafka 数据源中通常包含消费 offset、group id 以及以 `property.` 前缀传入的 Kafka 客户端参数。 | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | 作业运行统计信息。常用字段包括 `receivedBytes`、`loadedRows`、`errorRows`、`committedTaskNum`、`abortedTaskNum`、`loadRowsRate`、`taskExecuteTimeMs` 等。 | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | 作业运行进度。Kafka 数据源中显示每个分区当前已消费的 offset。 | `{"0":"2"}` |
+| LAG | text | 作业延迟信息。Kafka 数据源中显示每个分区的消费积压量。 | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | 作业状态变更原因。正常运行时通常为空；异常暂停或取消时记录具体原因。 | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | 错误日志 URL，用于查看被过滤的质量不合格数据。无错误日志时为空。 | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | 创建或操作该作业的用户。 | `root` |
+| CURRENT_ABORT_TASK_NUM | int | 当前失败的子任务数量。 | `0` |
+| IS_ABNORMAL_PAUSE | boolean | 是否为非用户手动触发的异常暂停。`true` 表示系统因异常原因暂停作业，`false` 表示没有异常暂停。 | `false` |
+
+## 查询异常作业
+
+如果作业异常暂停、存在失败任务，或处于 `RUNNING` 状态但没有正在执行的子任务，同时 Kafka 仍有消费积压，都可以视为需要进一步排查的异常作业。可以通过以下 SQL 查询这些作业：
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+查询到异常作业后，可以切换到对应数据库，通过 `SHOW ROUTINE LOAD` 查看作业详情：
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+其中 `LAG` 是 Kafka 各分区的消费积压信息。`LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` 用于匹配至少有一个分区存在大于 0 的积压。
diff --git a/ja-source/docusaurus-plugin-content-docs/current/admin-manual/system-tables/information_schema/routine_load_job.md b/ja-source/docusaurus-plugin-content-docs/current/admin-manual/system-tables/information_schema/routine_load_job.md
index 297e00c6e0c..cb94fa52bdf 100644
--- a/ja-source/docusaurus-plugin-content-docs/current/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/ja-source/docusaurus-plugin-content-docs/current/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -9,31 +9,60 @@
routine load ジョブの情報を表示するために使用されます。
-## データベース
+## データベースとテーブル
-`information_schema`
+`information_schema.routine_load_jobs`
## テーブル情報
-| カラム名 | 型 | 説明 |
-| :-------------------- | :-------- | :----------------------------------------- |
-| JOB_ID | text | ジョブ ID |
-| JOB_NAME | text | ジョブ名 |
-| CREATE_TIME | text | ジョブ作成時刻 |
-| PAUSE_TIME | text | ジョブ一時停止時刻 |
-| END_TIME | text | ジョブ終了時刻 |
-| DB_NAME | text | データベース名 |
-| TABLE_NAME | text | テーブル名 |
-| STATE | text | ジョブステータス |
-| CURRENT_TASK_NUM | text | 現在のサブタスク数 |
-| JOB_PROPERTIES | text | ジョブプロパティ設定 |
-| DATA_SOURCE_PROPERTIES| text | データソースプロパティ設定 |
-| CUSTOM_PROPERTIES | text | カスタムプロパティ設定 |
-| STATISTIC | text | ジョブ統計情報 |
-| PROGRESS | text | ジョブ進捗情報 |
-| LAG | text | ジョブ遅延情報 |
-| REASON_OF_STATE_CHANGED| text | ジョブステータス変更理由 |
-| ERROR_LOG_URLS | text | エラーログURL |
-| USER_NAME | text | ユーザー名 |
-| CURRENT_ABORT_TASK_NUM| int | 現在の失敗タスク数 |
-| IS_ABNORMAL_PAUSE | boolean | システムによる一時停止かどうか（ユーザー以外による一時停止） |
+| カラム名 | 型 | 説明 | 例 |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :-- |
+| JOB_ID | text | Doris によって自動生成されるジョブ ID。 | `12025` |
+| JOB_NAME | text | Routine Load ジョブ名。 | `example_routine_load` |
+| CREATE_TIME | text | ジョブ作成時刻。 | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | 直近のジョブ一時停止時刻。ジョブが一時停止されていない場合は `NULL`。 | `NULL` |
+| END_TIME | text | ジョブ終了時刻。ジョブが終了していない場合は `NULL`。 | `NULL` |
+| DB_NAME | text | ジョブが属するデータベース名。 | `default_cluster:testdb` |
+| TABLE_NAME | text | ジョブのインポート先テーブル名。マルチテーブルインポートの場合は `multi-table` と表示されます。 | `test_routineload_tbl` |
+| STATE | text | ジョブ実行状態。`NEED_SCHEDULE`、`RUNNING`、`PAUSED`、`STOPPED`、`CANCELLED` があります。 | `RUNNING` |
+| CURRENT_TASK_NUM | text | 現在スケジュール中または実行中のサブタスク数。 | `1` |
+| JOB_PROPERTIES | text | ジョブプロパティ設定。バッチサイズ、並行数、インポート形式、カラムマッピング、エラー許容設定などを含みます。 | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | データソースプロパティ設定。Kafka の場合、topic、broker リスト、現在の Kafka パーティションなどを含みます。 | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | ジョブ作成時に設定されたカスタムプロパティ。Kafka の場合、通常は offset、group id、および `property.` プレフィックスで渡された Kafka クライアントパラメータを含みます。 | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | ジョブ実行統計情報。よく使われるフィールドには `receivedBytes`、`loadedRows`、`errorRows`、`committedTaskNum`、`abortedTaskNum`、`loadRowsRate`、`taskExecuteTimeMs` などがあります。 | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | ジョブ実行進捗。Kafka の場合、各パーティションの現在の消費済み offset を表示します。 | `{"0":"2"}` |
+| LAG | text | ジョブ遅延情報。Kafka の場合、各パーティションの消費ラグを表示します。 | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | ジョブ状態変更の理由。正常実行中は通常空で、異常一時停止またはキャンセル時に具体的な理由が記録されます。 | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | 品質チェックでフィルタされた不正データを確認するためのエラーログ URL。エラーログがない場合は空です。 | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | ジョブを作成または操作したユーザー。 | `root` |
+| CURRENT_ABORT_TASK_NUM | int | 現在の失敗サブタスク数。 | `0` |
+| IS_ABNORMAL_PAUSE | boolean | ユーザーの手動操作ではなく、システムによって異常一時停止されたかどうか。`true` はシステムによる異常一時停止、`false` は異常一時停止なしを表します。 | `false` |
+
+## 異常ジョブの確認
+
+ジョブが異常一時停止している、失敗タスクが存在する、または `RUNNING` 状態だが実行中のサブタスクがなく Kafka に消費ラグが残っている場合は、追加調査が必要な異常ジョブとみなせます。以下の SQL でこれらのジョブを確認できます。
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+異常ジョブが見つかったら、対応するデータベースに切り替え、`SHOW ROUTINE LOAD` でジョブ詳細を確認します。
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+`LAG` は Kafka の各パーティションの消費ラグ情報です。`LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` は、少なくとも 1 つのパーティションに 0 より大きいラグがあるジョブにマッチします。
diff --git a/ja-source/docusaurus-plugin-content-docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md b/ja-source/docusaurus-plugin-content-docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md
index db1c53ab79d..cb94fa52bdf 100644
--- a/ja-source/docusaurus-plugin-content-docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/ja-source/docusaurus-plugin-content-docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -2,38 +2,67 @@
{
"title": "routine_load_job",
"language": "ja",
- "description": "ルーチンロードジョブに関する情報を表示するために使用されます。この機能はバージョン3.0.5で導入されました。"
+ "description": "ルーチンロードジョブに関する情報を表示するために使用されます。"
}
---
## 概要
-routine loadジョブに関する情報を表示するために使用されます。この機能はバージョン3.0.5で導入されました。
+routine load ジョブの情報を表示するために使用されます。
-## データベース
+## データベースとテーブル
-`information_schema`
+`information_schema.routine_load_jobs`
## テーブル情報
-| カラム名 | 型 | 説明 |
-| :-------------------- | :-------- | :----------------------------------------- |
-| JOB_ID | text | ジョブID |
-| JOB_NAME | text | ジョブ名 |
-| CREATE_TIME | text | ジョブ作成時刻 |
-| PAUSE_TIME | text | ジョブ一時停止時刻 |
-| END_TIME | text | ジョブ終了時刻 |
-| DB_NAME | text | データベース名 |
-| TABLE_NAME | text | テーブル名 |
-| STATE | text | ジョブステータス |
-| CURRENT_TASK_NUM | text | 現在のサブタスク数 |
-| JOB_PROPERTIES | text | ジョブプロパティ設定 |
-| DATA_SOURCE_PROPERTIES| text | データソースプロパティ設定 |
-| CUSTOM_PROPERTIES | text | カスタムプロパティ設定 |
-| STATISTIC | text | ジョブ統計情報 |
-| PROGRESS | text | ジョブ進捗情報 |
-| LAG | text | ジョブ遅延情報 |
-| REASON_OF_STATE_CHANGED| text | ジョブステータス変更理由 |
-| ERROR_LOG_URLS | text | エラーログURL |
-| USER_NAME | text | ユーザー名 |
-| CURRENT_ABORT_TASK_NUM| int | 現在の失敗タスク数 |
-| IS_ABNORMAL_PAUSE | boolean | システムによる一時停止かどうか（ユーザー一時停止以外） |
+| カラム名 | 型 | 説明 | 例 |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :-- |
+| JOB_ID | text | Doris によって自動生成されるジョブ ID。 | `12025` |
+| JOB_NAME | text | Routine Load ジョブ名。 | `example_routine_load` |
+| CREATE_TIME | text | ジョブ作成時刻。 | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | 直近のジョブ一時停止時刻。ジョブが一時停止されていない場合は `NULL`。 | `NULL` |
+| END_TIME | text | ジョブ終了時刻。ジョブが終了していない場合は `NULL`。 | `NULL` |
+| DB_NAME | text | ジョブが属するデータベース名。 | `default_cluster:testdb` |
+| TABLE_NAME | text | ジョブのインポート先テーブル名。マルチテーブルインポートの場合は `multi-table` と表示されます。 | `test_routineload_tbl` |
+| STATE | text | ジョブ実行状態。`NEED_SCHEDULE`、`RUNNING`、`PAUSED`、`STOPPED`、`CANCELLED` があります。 | `RUNNING` |
+| CURRENT_TASK_NUM | text | 現在スケジュール中または実行中のサブタスク数。 | `1` |
+| JOB_PROPERTIES | text | ジョブプロパティ設定。バッチサイズ、並行数、インポート形式、カラムマッピング、エラー許容設定などを含みます。 | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | データソースプロパティ設定。Kafka の場合、topic、broker リスト、現在の Kafka パーティションなどを含みます。 | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | ジョブ作成時に設定されたカスタムプロパティ。Kafka の場合、通常は offset、group id、および `property.` プレフィックスで渡された Kafka クライアントパラメータを含みます。 | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | ジョブ実行統計情報。よく使われるフィールドには `receivedBytes`、`loadedRows`、`errorRows`、`committedTaskNum`、`abortedTaskNum`、`loadRowsRate`、`taskExecuteTimeMs` などがあります。 | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | ジョブ実行進捗。Kafka の場合、各パーティションの現在の消費済み offset を表示します。 | `{"0":"2"}` |
+| LAG | text | ジョブ遅延情報。Kafka の場合、各パーティションの消費ラグを表示します。 | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | ジョブ状態変更の理由。正常実行中は通常空で、異常一時停止またはキャンセル時に具体的な理由が記録されます。 | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | 品質チェックでフィルタされた不正データを確認するためのエラーログ URL。エラーログがない場合は空です。 | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | ジョブを作成または操作したユーザー。 | `root` |
+| CURRENT_ABORT_TASK_NUM | int | 現在の失敗サブタスク数。 | `0` |
+| IS_ABNORMAL_PAUSE | boolean | ユーザーの手動操作ではなく、システムによって異常一時停止されたかどうか。`true` はシステムによる異常一時停止、`false` は異常一時停止なしを表します。 | `false` |
+
+## 異常ジョブの確認
+
+ジョブが異常一時停止している、失敗タスクが存在する、または `RUNNING` 状態だが実行中のサブタスクがなく Kafka に消費ラグが残っている場合は、追加調査が必要な異常ジョブとみなせます。以下の SQL でこれらのジョブを確認できます。
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+異常ジョブが見つかったら、対応するデータベースに切り替え、`SHOW ROUTINE LOAD` でジョブ詳細を確認します。
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+`LAG` は Kafka の各パーティションの消費ラグ情報です。`LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` は、少なくとも 1 つのパーティションに 0 より大きいラグがあるジョブにマッチします。
diff --git a/ja-source/docusaurus-plugin-content-docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md b/ja-source/docusaurus-plugin-content-docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md
index fce3ed016e2..cb94fa52bdf 100644
--- a/ja-source/docusaurus-plugin-content-docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/ja-source/docusaurus-plugin-content-docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -2,38 +2,67 @@
{
"title": "routine_load_job",
"language": "ja",
- "description": "定期ロードジョブに関する情報を表示するために使用されます。"
+ "description": "ルーチンロードジョブに関する情報を表示するために使用されます。"
}
---
## 概要
-routine load ジョブに関する情報を表示するために使用されます。
+routine load ジョブの情報を表示するために使用されます。
-## データベース
+## データベースとテーブル
-`information_schema`
+`information_schema.routine_load_jobs`
## テーブル情報
-| カラム名 | 型 | 説明 |
-| :-------------------- | :-------- | :----------------------------------------- |
-| JOB_ID | text | ジョブID |
-| JOB_NAME | text | ジョブ名 |
-| CREATE_TIME | text | ジョブ作成時刻 |
-| PAUSE_TIME | text | ジョブ一時停止時刻 |
-| END_TIME | text | ジョブ終了時刻 |
-| DB_NAME | text | データベース名 |
-| TABLE_NAME | text | テーブル名 |
-| STATE | text | ジョブ状態 |
-| CURRENT_TASK_NUM | text | 現在のサブタスク数 |
-| JOB_PROPERTIES | text | ジョブプロパティ設定 |
-| DATA_SOURCE_PROPERTIES| text | データソースプロパティ設定 |
-| CUSTOM_PROPERTIES | text | カスタムプロパティ設定 |
-| STATISTIC | text | ジョブ統計情報 |
-| PROGRESS | text | ジョブ進行状況情報 |
-| LAG | text | ジョブ遅延情報 |
-| REASON_OF_STATE_CHANGED| text | ジョブ状態変更の理由 |
-| ERROR_LOG_URLS | text | エラーログURL |
-| USER_NAME | text | ユーザー名 |
-| CURRENT_ABORT_TASK_NUM| int | 現在の失敗タスク数 |
-| IS_ABNORMAL_PAUSE | boolean | システムによる一時停止かどうか（ユーザー以外による一時停止） |
+| カラム名 | 型 | 説明 | 例 |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :-- |
+| JOB_ID | text | Doris によって自動生成されるジョブ ID。 | `12025` |
+| JOB_NAME | text | Routine Load ジョブ名。 | `example_routine_load` |
+| CREATE_TIME | text | ジョブ作成時刻。 | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | 直近のジョブ一時停止時刻。ジョブが一時停止されていない場合は `NULL`。 | `NULL` |
+| END_TIME | text | ジョブ終了時刻。ジョブが終了していない場合は `NULL`。 | `NULL` |
+| DB_NAME | text | ジョブが属するデータベース名。 | `default_cluster:testdb` |
+| TABLE_NAME | text | ジョブのインポート先テーブル名。マルチテーブルインポートの場合は `multi-table` と表示されます。 | `test_routineload_tbl` |
+| STATE | text | ジョブ実行状態。`NEED_SCHEDULE`、`RUNNING`、`PAUSED`、`STOPPED`、`CANCELLED` があります。 | `RUNNING` |
+| CURRENT_TASK_NUM | text | 現在スケジュール中または実行中のサブタスク数。 | `1` |
+| JOB_PROPERTIES | text | ジョブプロパティ設定。バッチサイズ、並行数、インポート形式、カラムマッピング、エラー許容設定などを含みます。 | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | データソースプロパティ設定。Kafka の場合、topic、broker リスト、現在の Kafka パーティションなどを含みます。 | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | ジョブ作成時に設定されたカスタムプロパティ。Kafka の場合、通常は offset、group id、および `property.` プレフィックスで渡された Kafka クライアントパラメータを含みます。 | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | ジョブ実行統計情報。よく使われるフィールドには `receivedBytes`、`loadedRows`、`errorRows`、`committedTaskNum`、`abortedTaskNum`、`loadRowsRate`、`taskExecuteTimeMs` などがあります。 | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | ジョブ実行進捗。Kafka の場合、各パーティションの現在の消費済み offset を表示します。 | `{"0":"2"}` |
+| LAG | text | ジョブ遅延情報。Kafka の場合、各パーティションの消費ラグを表示します。 | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | ジョブ状態変更の理由。正常実行中は通常空で、異常一時停止またはキャンセル時に具体的な理由が記録されます。 | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | 品質チェックでフィルタされた不正データを確認するためのエラーログ URL。エラーログがない場合は空です。 | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | ジョブを作成または操作したユーザー。 | `root` |
+| CURRENT_ABORT_TASK_NUM | int | 現在の失敗サブタスク数。 | `0` |
+| IS_ABNORMAL_PAUSE | boolean | ユーザーの手動操作ではなく、システムによって異常一時停止されたかどうか。`true` はシステムによる異常一時停止、`false` は異常一時停止なしを表します。 | `false` |
+
+## 異常ジョブの確認
+
+ジョブが異常一時停止している、失敗タスクが存在する、または `RUNNING` 状態だが実行中のサブタスクがなく Kafka に消費ラグが残っている場合は、追加調査が必要な異常ジョブとみなせます。以下の SQL でこれらのジョブを確認できます。
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+異常ジョブが見つかったら、対応するデータベースに切り替え、`SHOW ROUTINE LOAD` でジョブ詳細を確認します。
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+`LAG` は Kafka の各パーティションの消費ラグ情報です。`LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` は、少なくとも 1 つのパーティションに 0 より大きいラグがあるジョブにマッチします。
diff --git a/versioned_docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md b/versioned_docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md
index bf412162cb7..8acc853f73b 100644
--- a/versioned_docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/versioned_docs/version-3.x/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -2,39 +2,68 @@
{
"title": "routine_load_job",
"language": "en",
- "description": "Used to view information about routine load jobs. This feature was introduced in version 3.0.5."
+ "description": "Used to view information about routine load jobs."
}
---
## Overview
-Used to view information about routine load jobs. This feature was introduced in version 3.0.5.
+Used to view information about routine load jobs.
-## Database
+## Database and Table
-`information_schema`
+`information_schema.routine_load_jobs`
## Table Information
-| Column Name | Type | Description |
-| :-------------------- | :-------- | :----------------------------------------- |
-| JOB_ID | text | Job ID |
-| JOB_NAME | text | Job name |
-| CREATE_TIME | text | Job creation time |
-| PAUSE_TIME | text | Job pause time |
-| END_TIME | text | Job end time |
-| DB_NAME | text | Database name |
-| TABLE_NAME | text | Table name |
-| STATE | text | Job status |
-| CURRENT_TASK_NUM | text | Current number of subtasks |
-| JOB_PROPERTIES | text | Job property configurations |
-| DATA_SOURCE_PROPERTIES| text | Data source property configurations |
-| CUSTOM_PROPERTIES | text | Custom property configurations |
-| STATISTIC | text | Job statistics information |
-| PROGRESS | text | Job progress information |
-| LAG | text | Job delay information |
-| REASON_OF_STATE_CHANGED| text | Reason for job status change |
-| ERROR_LOG_URLS | text | Error log URLs |
-| USER_NAME | text | Username |
-| CURRENT_ABORT_TASK_NUM| int | Current number of failed tasks |
-| IS_ABNORMAL_PAUSE | boolean | Whether paused by system (non-user pause) |
\ No newline at end of file
+| Column Name | Type | Description | Example |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :------ |
+| JOB_ID | text | Job ID generated by Doris. | `12025` |
+| JOB_NAME | text | Routine Load job name. | `example_routine_load` |
+| CREATE_TIME | text | Job creation time. | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | Most recent job pause time. It is `NULL` if the job has not been paused. | `NULL` |
+| END_TIME | text | Job end time. It is `NULL` if the job has not ended. | `NULL` |
+| DB_NAME | text | Database name of the job. | `default_cluster:testdb` |
+| TABLE_NAME | text | Target table name of the job. For multi-table import jobs, this value is `multi-table`. | `test_routineload_tbl` |
+| STATE | text | Job running status, including `NEED_SCHEDULE`, `RUNNING`, `PAUSED`, `STOPPED`, and `CANCELLED`. | `RUNNING` |
+| CURRENT_TASK_NUM | text | Number of subtasks currently being scheduled or executed. | `1` |
+| JOB_PROPERTIES | text | Job property configurations, including batch size, concurrency, import format, column mapping, and error tolerance. | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | Data source property configurations. For Kafka, this includes topic, broker list, and current Kafka partitions. | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | Custom properties configured when creating the job. For Kafka, this usually includes offsets, group id, and Kafka client parameters passed with `property.` prefixes. | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | Job runtime statistics. Common fields include `receivedBytes`, `loadedRows`, `errorRows`, `committedTaskNum`, `abortedTaskNum`, `loadRowsRate`, and `taskExecuteTimeMs`. | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | Job running progress. For Kafka, it shows the consumed offset of each partition. | `{"0":"2"}` |
+| LAG | text | Job lag information. For Kafka, it shows the consumption lag of each partition. | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | Reason for the job state change. It is usually empty for normally running jobs, and records the specific reason when the job is paused or cancelled abnormally. | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | Error log URLs for viewing filtered data that failed quality checks. It is empty if there is no error log. | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | User who created or operated the job. | `root` |
+| CURRENT_ABORT_TASK_NUM | int | Current number of failed subtasks. | `0` |
+| IS_ABNORMAL_PAUSE | boolean | Whether the job was paused abnormally by the system instead of manually by a user. `true` indicates an abnormal system pause, and `false` indicates no abnormal pause. | `false` |
+
+## Query Abnormal Jobs
+
+If a job is abnormally paused, has failed tasks, or is in the `RUNNING` state but has no running subtasks while Kafka still has consumption lag, it should be investigated. You can use the following SQL to query these jobs:
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+After finding an abnormal job, switch to the corresponding database and use `SHOW ROUTINE LOAD` to view the job details:
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+`LAG` is the Kafka consumption lag information for each partition. `LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` matches jobs where at least one partition has a lag greater than 0.
diff --git a/versioned_docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md b/versioned_docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md
index f35b0ee1955..8acc853f73b 100644
--- a/versioned_docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md
+++ b/versioned_docs/version-4.x/admin-manual/system-tables/information_schema/routine_load_job.md
@@ -10,31 +10,60 @@
Used to view information about routine load jobs.
-## Database
+## Database and Table
-`information_schema`
+`information_schema.routine_load_jobs`
## Table Information
-| Column Name | Type | Description |
-| :-------------------- | :-------- | :----------------------------------------- |
-| JOB_ID | text | Job ID |
-| JOB_NAME | text | Job name |
-| CREATE_TIME | text | Job creation time |
-| PAUSE_TIME | text | Job pause time |
-| END_TIME | text | Job end time |
-| DB_NAME | text | Database name |
-| TABLE_NAME | text | Table name |
-| STATE | text | Job status |
-| CURRENT_TASK_NUM | text | Current number of subtasks |
-| JOB_PROPERTIES | text | Job property configurations |
-| DATA_SOURCE_PROPERTIES| text | Data source property configurations |
-| CUSTOM_PROPERTIES | text | Custom property configurations |
-| STATISTIC | text | Job statistics information |
-| PROGRESS | text | Job progress information |
-| LAG | text | Job delay information |
-| REASON_OF_STATE_CHANGED| text | Reason for job status change |
-| ERROR_LOG_URLS | text | Error log URLs |
-| USER_NAME | text | Username |
-| CURRENT_ABORT_TASK_NUM| int | Current number of failed tasks |
-| IS_ABNORMAL_PAUSE | boolean | Whether paused by system (non-user pause) |
\ No newline at end of file
+| Column Name | Type | Description | Example |
+| :----------------------- | :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------ | :------ |
+| JOB_ID | text | Job ID generated by Doris. | `12025` |
+| JOB_NAME | text | Routine Load job name. | `example_routine_load` |
+| CREATE_TIME | text | Job creation time. | `2024-01-15 08:12:42` |
+| PAUSE_TIME | text | Most recent job pause time. It is `NULL` if the job has not been paused. | `NULL` |
+| END_TIME | text | Job end time. It is `NULL` if the job has not ended. | `NULL` |
+| DB_NAME | text | Database name of the job. | `default_cluster:testdb` |
+| TABLE_NAME | text | Target table name of the job. For multi-table import jobs, this value is `multi-table`. | `test_routineload_tbl` |
+| STATE | text | Job running status, including `NEED_SCHEDULE`, `RUNNING`, `PAUSED`, `STOPPED`, and `CANCELLED`. | `RUNNING` |
+| CURRENT_TASK_NUM | text | Number of subtasks currently being scheduled or executed. | `1` |
+| JOB_PROPERTIES | text | Job property configurations, including batch size, concurrency, import format, column mapping, and error tolerance. | `{"max_batch_rows":"200000","format":"csv","columnToColumnExpr":"user_id,name,age","max_filter_ratio":"1.0"}` |
+| DATA_SOURCE_PROPERTIES | text | Data source property configurations. For Kafka, this includes topic, broker list, and current Kafka partitions. | `{"topic":"test-topic","currentKafkaPartitions":"0","brokerList":"192.168.88.62:9092"}` |
+| CUSTOM_PROPERTIES | text | Custom properties configured when creating the job. For Kafka, this usually includes offsets, group id, and Kafka client parameters passed with `property.` prefixes. | `{"kafka_default_offsets":"OFFSET_BEGINNING","group.id":"example_routine_load_73daf600-884e-46c0-a02b-4e49fdf3b4dc"}` |
+| STATISTIC | text | Job runtime statistics. Common fields include `receivedBytes`, `loadedRows`, `errorRows`, `committedTaskNum`, `abortedTaskNum`, `loadRowsRate`, and `taskExecuteTimeMs`. | `{"receivedBytes":28,"runningTxns":[],"errorRows":0,"committedTaskNum":3,"loadedRows":3,"loadRowsRate":0,"abortedTaskNum":0,"errorRowsAfterResumed":0,"totalRows":3,"unselectedRows":0,"receivedBytesRate":0,"taskExecuteTimeMs":30069}` |
+| PROGRESS | text | Job running progress. For Kafka, it shows the consumed offset of each partition. | `{"0":"2"}` |
+| LAG | text | Job lag information. For Kafka, it shows the consumption lag of each partition. | `{"0":0}` |
+| REASON_OF_STATE_CHANGED | text | Reason for the job state change. It is usually empty for normally running jobs, and records the specific reason when the job is paused or cancelled abnormally. | `The number of failed task exceeded max_error_number` |
+| ERROR_LOG_URLS | text | Error log URLs for viewing filtered data that failed quality checks. It is empty if there is no error log. | `http://fe_host:8030/api/_load_error_log?file=error.log` |
+| USER_NAME | text | User who created or operated the job. | `root` |
+| CURRENT_ABORT_TASK_NUM | int | Current number of failed subtasks. | `0` |
+| IS_ABNORMAL_PAUSE | boolean | Whether the job was paused abnormally by the system instead of manually by a user. `true` indicates an abnormal system pause, and `false` indicates no abnormal pause. | `false` |
+
+## Query Abnormal Jobs
+
+If a job is abnormally paused, has failed tasks, or is in the `RUNNING` state but has no running subtasks while Kafka still has consumption lag, it should be investigated. You can use the following SQL to query these jobs:
+
+```sql
+SELECT DB_NAME, JOB_NAME
+FROM information_schema.routine_load_jobs
+WHERE IS_ABNORMAL_PAUSE = TRUE
+ OR (
+ STATE = 'RUNNING'
+ AND (
+ CURRENT_ABORT_TASK_NUM > 0
+ OR (
+ CAST(CURRENT_TASK_NUM AS INT) = 0
+ AND `LAG` REGEXP ':[[:space:]]*[1-9][0-9]*'
+ )
+ )
+ );
+```
+
+After finding an abnormal job, switch to the corresponding database and use `SHOW ROUTINE LOAD` to view the job details:
+
+```sql
+USE `db_name`;
+SHOW ROUTINE LOAD FOR `job_name`;
+```
+
+`LAG` is the Kafka consumption lag information for each partition. `LAG REGEXP ':[[:space:]]*[1-9][0-9]*'` matches jobs where at least one partition has a lag greater than 0.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org