You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2021/01/08 04:34:55 UTC
[GitHub] [incubator-doris] HappenLee opened a new issue #5206: [Proposal] Push Down _conjunct of not in and not eq expr to Storage Engine
HappenLee opened a new issue #5206:
URL: https://github.com/apache/incubator-doris/issues/5206
**Is your feature request related to a problem? Please describe.**
#### case:
Now if we query like
```
select * from test where a not in ('a', 'b', 'c')；
```
`
a is not null ('a', 'b', 'c')
`need push down to Storage Engine.
#### Test
```
CREATE TABLE `customer3` (
`C_CUSTKEY` int(11) NULL COMMENT "",
`C_NAME` varchar(64) NULL COMMENT "",
`C_ADDRESS` varchar(64) NULL COMMENT "",
`C_CITY` varchar(64) NULL COMMENT "",
`C_NATION` varchar(64) NULL COMMENT "",
`C_REGION` varchar(64) NULL COMMENT "",
`C_PHONE` varchar(64) NULL COMMENT "",
`C_MKTSEGMENT` varchar(64) NULL COMMENT ""
) ENGINE=OLAP
DUPLICATE KEY(`C_CUSTKEY`, `C_NAME`)
COMMENT "OLAP"
DISTRIBUTED BY HASH(`C_NATION`) BUCKETS 1
PROPERTIES (
"replication_num" = "1",
"in_memory" = "false",
"storage_format" = "V2"
);
```
execute query
```
select * from customer3 where C_NATION not in ("JAPAN", "CHINA") order by C_CUSTKEY limit 10, 15;
```
`not in` will filter about 1000W data
the execute result as list:
| origin | push down not in |
| :-----: | :----: |
| 2.3s | 0.69s |
This optimization can greatly improve the query performance of Doris in some scenarios
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] HappenLee closed issue #5206: [Proposal] Push Down _conjunct of not in and not eq expr to Storage Engine
Posted by GitBox <gi...@apache.org>.
HappenLee closed issue #5206:
URL: https://github.com/apache/incubator-doris/issues/5206
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org