You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/09/29 12:09:43 UTC
[GitHub] [doris] weizuo93 opened a new issue, #13064: [Bug] Last line of data lost for stream load
weizuo93 opened a new issue, #13064:
URL: https://github.com/apache/doris/issues/13064
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Version
master (commit id: a7b42a702917ddc1b919c841b001c5b3602188f9)
### What's Wrong?
Last line of data lost for stream load when line delimiter is more than one character.
### What You Expected?
All legitimate data can be load into doris.
### How to Reproduce?
Table:
```
CREATE TABLE `table_test` (
`id` int(11) NULL,
`value` varchar(64) NULL
) ENGINE=OLAP
DUPLICATE KEY(`id`)
COMMENT 'OLAP'
DISTRIBUTED BY HASH(`id`) BUCKETS 1
PROPERTIES (
"replication_allocation" = "tag.location.default: 1",
"in_memory" = "false",
"storage_format" = "V2",
"disable_auto_compaction" = "false"
);
```
Stream Load:
```
echo "1|aaweizuo2|bbweizuo3|cc" | curl --location-trusted -u xxx:xxx -H "label:test43" -H "line_delimiter:weizuo" -H "column_separator:|" -T - http://xxx:8030/api/test_db/table_test/_stream_load;
{
"TxnId": 4014,
"Label": "test43",
"TwoPhaseCommit": "false",
"Status": "Success",
"Message": "OK",
"NumberTotalRows": 2,
"NumberLoadedRows": 2,
"NumberFilteredRows": 0,
"NumberUnselectedRows": 0,
"LoadBytes": 25,
"LoadTimeMs": 30,
"BeginTxnTimeMs": 0,
"StreamLoadPutTimeMs": 1,
"ReadDataTimeMs": 0,
"WriteDataTimeMs": 9,
"CommitAndPublishTimeMs": 19
}
```
Result:
```
mysql> select * from table_test;
+------+-------+
| id | value |
+------+-------+
| 1 | aa |
| 2 | bb |
+------+-------+
2 rows in set (0.01 sec)
```
### Anything Else?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] dataroaring closed issue #13064: [Bug] Last line of data lost for stream load
Posted by GitBox <gi...@apache.org>.
dataroaring closed issue #13064: [Bug] Last line of data lost for stream load
URL: https://github.com/apache/doris/issues/13064
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org