You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "XieJiann (via GitHub)" <gi...@apache.org> on 2023/12/21 10:13:21 UTC
[PR] [feature](Nereids): eliminate left outer join by foreign key [doris]
XieJiann opened a new pull request, #28816:
URL: https://github.com/apache/doris/pull/28816
## Proposed changes
eliminate left outer join by foreign key
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "xzj7019 (via GitHub)" <gi...@apache.org>.
xzj7019 commented on code in PR #28816:
URL: https://github.com/apache/doris/pull/28816#discussion_r1437613158
##########
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/EliminateJoinByFK.java:
##########
@@ -143,47 +127,56 @@ private Plan applyNullCompensationFilter(Plan child, Set<Slot> childSlots) {
return new LogicalFilter<>(predicates, child);
}
- private @Nullable Plan tryConstructPlanWithJoinChild(LogicalProject<LogicalJoin<?, ?>> project, Plan child,
- BiMap<Slot, Slot> equalSlots, ForeignKeyContext context) {
+ private Plan tryEliminatePrimaryPlan(LogicalProject<LogicalJoin<?, ?>> project,
+ Plan foreignPlan, Set<Slot> foreignKeys,
+ Map<Slot, Slot> primaryToForeign, ForeignKeyContext context) {
Set<Slot> output = project.getInputSlots();
- Set<Slot> keySet = child.getOutputSet().containsAll(equalSlots.keySet())
- ? equalSlots.keySet()
- : equalSlots.values();
- Map<Expression, Expression> outputToRight = tryGetOutputToChildMap(child, output, equalSlots);
- if (outputToRight != null && isForeignKeyAndUnique(child, keySet, context)) {
+ Map<Expression, Expression> outputToForeign =
+ tryMapOutputToForeignPlan(foreignPlan, output, primaryToForeign);
+ if (outputToForeign != null && canEliminate(project.child(), primaryToForeign, context)) {
List<NamedExpression> newProjects = project.getProjects().stream()
- .map(e -> outputToRight.containsKey(e)
- ? new Alias(e.getExprId(), outputToRight.get(e), e.toSql())
- : (NamedExpression) e.rewriteUp(s -> outputToRight.getOrDefault(s, s)))
+ .map(e -> outputToForeign.containsKey(e)
+ ? new Alias(e.getExprId(), outputToForeign.get(e), e.toSql())
+ : (NamedExpression) e.rewriteUp(s -> outputToForeign.getOrDefault(s, s)))
.collect(ImmutableList.toImmutableList());
return project.withProjects(newProjects)
- .withChildren(applyNullCompensationFilter(child, keySet));
+ .withChildren(applyNullCompensationFilter(foreignPlan, foreignKeys));
}
- return null;
+ return project;
+ }
+
+ private @Nullable Map<Slot, Slot> mapPrimaryToForeign(ImmutableEquivalenceSet<Slot> equivalenceSet,
+ Set<Slot> foreignKeys) {
+ ImmutableMap.Builder<Slot, Slot> builder = new ImmutableMap.Builder<>();
+ for (Slot foreignSlot : foreignKeys) {
+ Set<Slot> primarySlots = equivalenceSet.calEqualSet(foreignSlot);
+ if (primarySlots.size() != 1) {
+ return null;
+ }
+ builder.put(primarySlots.iterator().next(), foreignSlot);
+ }
+ return builder.build();
}
// Right now we only support eliminate inner join, which should meet the following condition:
// 1. only contain null-reject equal condition, and which all meet fk-pk constraint
// 2. only output foreign table output or can be converted to foreign table output
- // 3. foreign key is unique
// 4. if foreign key is null, add a isNotNull predicate for null-reject join condition
Review Comment:
should be 3.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "XieJiann (via GitHub)" <gi...@apache.org>.
XieJiann commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1871178288
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1871173819
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1871743655
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1870126563
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit 814f6a2ef4fbce73141ed9da778a3fc88b5debd9, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4989 4634 4639 4634
q2 352 164 157 157
q3 1477 1320 1237 1237
q4 1126 969 905 905
q5 3199 3163 3159 3159
q6 249 127 129 127
q7 1039 494 506 494
q8 2266 2253 2264 2253
q9 6710 6706 6682 6682
q10 3212 3268 3248 3248
q11 326 208 206 206
q12 355 202 201 201
q13 4163 3451 3396 3396
q14 238 226 216 216
q15 573 517 529 517
q16 439 380 386 380
q17 1051 809 672 672
q18 7066 6822 8029 6822
q19 1628 1639 1649 1639
q20 525 297 309 297
q21 3188 2672 2736 2672
q22 368 312 316 312
Total cold run time: 44539 ms
Total hot run time: 40226 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4571 4572 4551 4551
q2 270 162 164 162
q3 3361 3353 3357 3353
q4 2222 2214 2213 2213
q5 5700 5705 5725 5705
q6 240 119 119 119
q7 2360 1851 1840 1840
q8 3607 3619 3601 3601
q9 8979 8993 8941 8941
q10 3790 3880 3899 3880
q11 494 369 351 351
q12 760 572 602 572
q13 3903 3193 3140 3140
q14 297 252 262 252
q15 571 512 518 512
q16 510 445 452 445
q17 1971 1958 1941 1941
q18 8605 8300 8104 8104
q19 1756 1737 1765 1737
q20 2237 1933 1931 1931
q21 6141 5748 5795 5748
q22 556 453 439 439
Total cold run time: 62901 ms
Total hot run time: 59537 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1871272236
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.45 seconds
stream load tsv: 562 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.3 seconds inserted 10000000 Rows, about 353K ops/s
storage size: 17183830934 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "XieJiann (via GitHub)" <gi...@apache.org>.
XieJiann commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1870085701
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener merged PR #28816:
URL: https://github.com/apache/doris/pull/28816
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1870985378
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.67 seconds
stream load tsv: 568 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17184169159 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "XieJiann (via GitHub)" <gi...@apache.org>.
XieJiann commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1870958556
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1870116347
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.71 seconds
stream load tsv: 569 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.0 seconds inserted 10000000 Rows, about 344K ops/s
storage size: 17184276307 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1871691980
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit 256a679b31220957b62081c8c34b1db489ab5071, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5493 5137 5142 5137
q2 390 202 199 199
q3 1461 1185 1174 1174
q4 1064 823 850 823
q5 3141 3229 3089 3089
q6 227 135 134 134
q7 980 567 530 530
q8 2159 2291 2216 2216
q9 6754 6685 6662 6662
q10 3209 3145 3184 3145
q11 354 228 232 228
q12 391 245 247 245
q13 4407 3679 3716 3679
q14 251 219 213 213
q15 624 571 578 571
q16 455 397 422 397
q17 1055 568 558 558
q18 7068 6758 6730 6730
q19 1651 1555 1512 1512
q20 599 350 363 350
q21 2959 2539 2465 2465
q22 386 321 348 321
Total cold run time: 45078 ms
Total hot run time: 40378 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 5112 5051 5094 5051
q2 344 259 284 259
q3 3373 3355 3328 3328
q4 2178 1990 1990 1990
q5 5950 5934 5925 5925
q6 236 133 132 132
q7 2397 1942 1965 1942
q8 3588 3652 3696 3652
q9 9068 9066 8999 8999
q10 3872 3919 3930 3919
q11 598 517 524 517
q12 805 667 671 667
q13 3893 3202 3220 3202
q14 301 285 284 284
q15 631 560 566 560
q16 559 531 535 531
q17 2005 1793 1795 1793
q18 8779 8450 8376 8376
q19 1766 1718 1731 1718
q20 2282 2003 1990 1990
q21 5706 5439 5419 5419
q22 586 504 490 490
Total cold run time: 64029 ms
Total hot run time: 60744 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1871272558
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit 9dece00960ccc2944ee33030c1c39f3f4eb9b2f4, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5458 5171 5100 5100
q2 392 163 160 160
q3 1457 1128 1204 1128
q4 1093 815 795 795
q5 3168 3091 3077 3077
q6 234 139 137 137
q7 984 551 541 541
q8 2157 2227 2184 2184
q9 6889 6864 6818 6818
q10 3187 3165 3176 3165
q11 350 230 225 225
q12 388 240 239 239
q13 4414 3666 3619 3619
q14 262 226 219 219
q15 640 558 578 558
q16 459 420 418 418
q17 1055 637 555 555
q18 7164 6851 6756 6756
q19 1649 1514 1443 1443
q20 569 395 341 341
q21 2893 2467 2487 2467
q22 402 330 333 330
Total cold run time: 45264 ms
Total hot run time: 40275 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 5235 5058 5041 5041
q2 347 255 244 244
q3 3367 3332 3323 3323
q4 2178 1987 2017 1987
q5 5943 5989 5938 5938
q6 234 132 130 130
q7 2366 1933 1947 1933
q8 3562 3632 3664 3632
q9 9085 9018 8967 8967
q10 3891 3941 3958 3941
q11 585 484 492 484
q12 826 654 643 643
q13 3910 3209 3212 3209
q14 312 278 268 268
q15 634 577 548 548
q16 545 523 523 523
q17 2028 1834 1816 1816
q18 8778 8395 8528 8395
q19 1768 1724 1758 1724
q20 2303 2009 2000 2000
q21 5748 5215 5301 5215
q22 594 526 489 489
Total cold run time: 64239 ms
Total hot run time: 60450 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1871169054
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1870981946
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit 82bb0061e3ddf2c72c7662418e4376c474a0ab97, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4976 4648 4637 4637
q2 381 156 155 155
q3 1463 1313 1239 1239
q4 1149 961 922 922
q5 3165 3178 3165 3165
q6 254 128 124 124
q7 1009 494 487 487
q8 2290 2256 2248 2248
q9 6692 6688 6652 6652
q10 3197 3253 3258 3253
q11 324 211 203 203
q12 351 210 212 210
q13 4180 3416 3406 3406
q14 239 208 216 208
q15 571 522 520 520
q16 451 398 388 388
q17 1058 758 483 483
q18 7071 6881 6750 6750
q19 1634 1633 1639 1633
q20 1226 309 326 309
q21 3188 2695 2683 2683
q22 360 297 308 297
Total cold run time: 45229 ms
Total hot run time: 39972 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4568 4567 4559 4559
q2 268 167 171 167
q3 3367 3369 3356 3356
q4 2218 2196 2192 2192
q5 5714 5703 5734 5703
q6 239 117 117 117
q7 2397 1863 1854 1854
q8 3602 3617 3610 3610
q9 9005 8996 9009 8996
q10 3809 3877 3882 3877
q11 472 359 367 359
q12 760 592 595 592
q13 3880 3205 3178 3178
q14 289 252 258 252
q15 562 512 512 512
q16 502 495 502 495
q17 1985 1960 1959 1959
q18 8632 8168 8370 8168
q19 1752 1774 1754 1754
q20 2233 1932 1903 1903
q21 6118 5758 5763 5758
q22 545 461 452 452
Total cold run time: 62917 ms
Total hot run time: 59813 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "XieJiann (via GitHub)" <gi...@apache.org>.
XieJiann commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1871683708
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids): refactor eliminating inner join by foreign key [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28816:
URL: https://github.com/apache/doris/pull/28816#issuecomment-1871695205
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.74 seconds
stream load tsv: 577 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.6 seconds inserted 10000000 Rows, about 349K ops/s
storage size: 17183585999 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org