You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "TangSiyang2001 (via GitHub)" <gi...@apache.org> on 2023/04/28 13:40:54 UTC
[GitHub] [doris] TangSiyang2001 opened a new issue, #19215: [Bug] A S3 load job will be submitted successfully with duplicated label of the former failed job
TangSiyang2001 opened a new issue, #19215:
URL: https://github.com/apache/doris/issues/19215
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
master
### What's Wrong?
As seen below, load job with the duplicate label will still submitted sucessfully, which cause the later cancel failed.
```
mysql> show load;
+-------+---------------+-----------+-------------------+--------+---------+-----------------------------------------------------+----------------------------------------------------------------------------------------------------------+---------------------+---------------------+---------------------+---------------------+---------------------+------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------+--------------+------+---------+
| JobId | Label | State | Progress | Type | EtlInfo | TaskInfo | ErrorMsg | CreateTime | EtlStartTime | EtlFinishTime | LoadStartTime | LoadFinishTime | URL | JobDetails | TransactionId | ErrorTablets | User | Comment |
+-------+---------------+-----------+-------------------+--------+---------+-----------------------------------------------------+----------------------------------------------------------------------------------------------------------+---------------------+---------------------+---------------------+---------------------+---------------------+------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------+--------------+------+---------+
| 11001 | lineitem_load | CANCELLED | ETL:N/A; LOAD:N/A | BROKER | NULL | cluster:N/A; timeout(s):14400; max_filter_ratio:0.0 | type:ETL_RUN_FAIL; msg:errCode = 2, detailMessage = Scan bytes per file scanner exceed limit: 3221225472 | 2023-04-28 20:50:28 | NULL | NULL | NULL | 2023-04-28 20:50:35 | NULL | {"Unfinished backends":{},"ScannedRows":0,"TaskNumber":0,"LoadBytes":0,"All backends":{},"FileNumber":1,"FileSize":7895697364} | 2 | {} | root | |
| 11004 | lineitem_load | CANCELLED | ETL:N/A; LOAD:N/A | BROKER | NULL | cluster:N/A; timeout(s):14400; max_filter_ratio:0.0 | type:ETL_RUN_FAIL; msg:errCode = 2, detailMessage = Scan bytes per file scanner exceed limit: 5368709120 | 2023-04-28 20:52:49 | NULL | NULL | NULL | 2023-04-28 20:52:54 | NULL | {"Unfinished backends":{},"ScannedRows":0,"TaskNumber":0,"LoadBytes":0,"All backends":{},"FileNumber":1,"FileSize":7895697364} | 3 | {} | root | |
| 11007 | lineitem_load | LOADING | ETL:100%; LOAD:3% | BROKER | NULL | cluster:N/A; timeout(s):14400; max_filter_ratio:0.0 | NULL | 2023-04-28 20:53:22 | 2023-04-28 20:53:23 | 2023-04-28 20:53:23 | 2023-04-28 20:53:23 | NULL | NULL | {"Unfinished backends":{"1fb727df9d134e05-b2fde24e8a2e1acf":[10011]},"ScannedRows":1682496,"TaskNumber":1,"LoadBytes":305841896,"All backends":{"1fb727df9d134e05-b2fde24e8a2e1acf":[10011]},"FileNumber":1,"FileSize":7895697364} | 4 | {} | root | |
+-------+---------------+-----------+-------------------+--------+---------+-----------------------------------------------------+----------------------------------------------------------------------------------------------------------+---------------------+---------------------+---------------------+---------------------+---------------------+------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------+--------------+------+---------+
3 rows in set (0.00 sec)
mysql> CANCEL LOAD FROM test WHERE LABEL = "lineitem_load";
ERROR 1105 (HY000): errCode = 2, detailMessage = Cancel load job [11001] fail, label=[lineitem_load] failed msg=errCode = 2, detailMessage = Job could not be cancelled when job is finished or cancelled
```
### What You Expected?
No job will be submitted successfully with a duplicated load label.
### How to Reproduce?
Make a S3 load fail, and submit a sucessful job with the same label, it will run normally. Then try to cancel it then failure occurs as shown.
### Anything Else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] dataroaring closed issue #19215: [Bug] A S3 load job will be submitted successfully with duplicated label of the former failed job, which causes a normal cancel falied
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring closed issue #19215: [Bug] A S3 load job will be submitted successfully with duplicated label of the former failed job, which causes a normal cancel falied
URL: https://github.com/apache/doris/issues/19215
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org