You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by GitBox <gi...@apache.org> on 2019/07/26 12:04:04 UTC
[GitHub] [incubator-doris] morningman opened a new issue #1557: Support
loading data into mutil tables in one load execution plan
morningman opened a new issue #1557: Support loading data into mutil tables in one load execution plan
URL: https://github.com/apache/incubator-doris/issues/1557
Currently, Doris only supports loading data into one table in a load execution plan.
Which means if user want to load the data from a file to, for example, 4 tables, it has to
generate 4 load execution plans, and each plan will read the data from file alone.
It is inefficient. So I would like to implement a new load execution plan which contains 2
new plan nodes:
1. DataDuplicateNode
DataDuplicateNode will get data from its child (such as BrokerScanNode), and duplicate
these data for target tuples.
2. MultiOlapTableSink
MultiOlapTableSink is a DataSink, which contains several OlapTableSink.
It should be the sink of DataDuplicateNode.
The plan fragment should looks like:
```
+--------------------------+
|PlanFragment |
| |
| +-------------------+ |
| |MultiOlapTableSink | |
| | | |
| | OlapTableSink +-----> TabletsChannel
| | | |
| | OlapTableSink +-----> TabletsChannel
| | | |
| | OlapTableSink +-----> TabletsChannel
| +---------^---------+ |
| | |
| | 2. Send |
| | |
| +--------+--------+ |
| | | |
| |DataDuplicateNode| |
| | | |
| +--------+--------+ |
| | |
| | 1. GetNext|
| | |
| +--------v--------+ |
| | | |
| | BrokerScanNode | |
| | | |
| +-----------------+ |
+--------------------------+
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For additional commands, e-mail: dev-help@doris.apache.org