You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/07/05 09:52:20 UTC
[GitHub] [doris] lide-reed opened a new issue, #10619: [Enhancement] Improve the performance of "insert into select" statement
lide-reed opened a new issue, #10619:
URL: https://github.com/apache/doris/issues/10619
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Description
Currently, the performence of "insert into select" statement is very poor, doris 1.1.0-rc03 is 37M/s for the cluster 3 BE Node (16c64g), and for the same case, the rate is 100G/s.
The detail as following:
`MySQL [ssb]> insert into lineorder_flat2 select * from lineorder_flat;
Query OK, 600037902 rows affected (26 min 52.81 sec)
{'label':'insert_2ed2773ca6654469-81283daa905be7c2', 'status':'VISIBLE', 'txnId':'235'}
MySQL [ssb]> show data;
+-----------------+-------------+--------------+
| TableName | Size | ReplicaCount |
+-----------------+-------------+--------------+
| customer | 138.437 MB | 12 |
| dates | 34.228 KB | 1 |
| lineorder | 14.611 GB | 336 |
| lineorder_flat | 58.854 GB | 336 |
| lineorder_flat2 | 58.854 GB | 336 |
| part | 12.969 MB | 12 |
| supplier | 9.158 MB | 12 |
| Total | 132.476 GB | 1045 |
| Quota | 1024.000 TB | 1073741824 |
| Left | 1023.871 TB | 1073740779 |
+-----------------+-------------+--------------+
10 rows in set (0.01 sec)`
### Solution
Refer the Implement of Impala rather than stream load? I'm not sure, Maybe Someone has good idea.
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] kpfly commented on issue #10619: [Enhancement] Improve the performance of "insert into select" statement
Posted by GitBox <gi...@apache.org>.
kpfly commented on issue #10619:
URL: https://github.com/apache/doris/issues/10619#issuecomment-1179750946
@zhannngchen @yixiutt will improve this scenario
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org