You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "eldenmoon (via GitHub)" <gi...@apache.org> on 2023/11/29 09:47:00 UTC
[PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
eldenmoon opened a new pull request, #27768:
URL: https://github.com/apache/doris/pull/27768
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "starocean999 (via GitHub)" <gi...@apache.org>.
starocean999 commented on code in PR #27768:
URL: https://github.com/apache/doris/pull/27768#discussion_r1463099228
##########
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/physical/PhysicalTVFRelation.java:
##########
@@ -107,7 +107,7 @@ public String toString() {
public List<Slot> computeOutput() {
return function.getTable().getBaseSchema()
.stream()
- .map(col -> SlotReference.fromColumn(col, ImmutableList.of()))
+ .map(col -> SlotReference.fromColumn(col, ImmutableList.of(), null))
Review Comment:
This is different from computeOutput() in LogicalTVFRelation, which pass 'this' as third param. Is this expected?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1905899274
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1833116697
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1833353921
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 833c09392fe09e69edc8b6eea47281a5cc26f55d, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4905 4647 4669 4647
q2 352 145 164 145
q3 1518 1320 1367 1320
q4 1167 957 958 957
q5 3258 3226 3264 3226
q6 247 133 133 133
q7 1012 524 610 524
q8 2205 2246 2221 2221
q9 6970 6988 6978 6978
q10 3293 3439 3367 3367
q11 344 216 213 213
q12 349 218 218 218
q13 5055 3875 3859 3859
q14 241 222 219 219
q15 584 536 516 516
q16 430 387 380 380
q17 1036 659 593 593
q18 8823 7877 7459 7459
q19 1550 1530 1549 1530
q20 817 328 331 328
q21 3405 3010 2998 2998
q22 368 297 306 297
Total cold run time: 47929 ms
Total hot run time: 42128 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4606 4608 4586 4586
q2 324 199 226 199
q3 3752 3758 3735 3735
q4 2537 2516 2521 2516
q5 6207 6216 6211 6211
q6 248 120 127 120
q7 2579 1934 1975 1934
q8 3747 3724 3717 3717
q9 9440 9439 9440 9439
q10 4093 4144 4160 4144
q11 642 534 490 490
q12 814 628 621 621
q13 4375 3714 3607 3607
q14 291 244 240 240
q15 582 535 529 529
q16 529 482 477 477
q17 2089 2094 2116 2094
q18 9562 8860 8999 8860
q19 1815 1786 1789 1786
q20 2321 2002 1974 1974
q21 7324 6935 7026 6935
q22 692 563 553 553
Total cold run time: 68569 ms
Total hot run time: 64767 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1831728504
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.09 seconds
stream load tsv: 560 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.4 seconds inserted 10000000 Rows, about 352K ops/s
storage size: 17162449238 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1833555673
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 43.52 seconds
stream load tsv: 564 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size: 17164086713 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1906039947
<details>
<summary>TPC-DS: <b>Total hot run time: 186319 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c22880621389cb371d5584e77361a94bba0b5922, data reload: false
query1 965 342 344 342
query2 6647 2089 1987 1987
query3 6889 215 212 212
query4 30321 22468 22123 22123
query5 4454 370 362 362
query6 262 155 152 152
query7 4613 264 255 255
query8 227 182 181 181
query9 8411 2565 2556 2556
query10 421 254 221 221
query11 16699 15464 15617 15464
query12 119 76 65 65
query13 1689 365 366 365
query14 10501 6895 6939 6895
query15 219 184 189 184
query16 5793 258 252 252
query17 940 465 484 465
query18 1801 258 250 250
query19 177 130 130 130
query20 69 73 68 68
query21 193 134 124 124
query22 4901 4775 4576 4576
query23 31740 30794 30898 30794
query24 13016 2870 2792 2792
query25 572 306 305 305
query26 1805 144 145 144
query27 3438 288 286 286
query28 7225 1819 1823 1819
query29 2164 638 625 625
query30 286 136 140 136
query31 960 745 767 745
query32 83 54 46 46
query33 716 212 211 211
query34 1260 446 458 446
query35 846 747 768 747
query36 1317 1218 1212 1212
query37 174 57 61 57
query38 3393 3243 3253 3243
query39 1319 1273 1261 1261
query40 353 80 85 80
query41 37 34 34 34
query42 86 81 78 78
query43 518 463 459 459
query44 1075 685 683 683
query45 194 180 178 178
query46 1060 640 655 640
query47 1597 1596 1576 1576
query48 390 316 309 309
query49 1229 287 288 287
query50 682 305 320 305
query51 5286 5238 5242 5238
query52 100 78 80 78
query53 320 261 257 257
query54 246 173 191 173
query55 83 76 78 76
query56 191 166 169 166
query57 1018 934 944 934
query58 188 166 167 166
query59 2871 2710 2555 2555
query60 207 185 184 184
query61 80 82 81 81
query62 635 392 356 356
query63 288 268 278 268
query64 6121 1793 1756 1756
query65 3336 3245 3252 3245
query66 1433 328 316 316
query67 15775 15483 14958 14958
query68 10556 522 519 519
query69 601 307 305 305
query70 1736 1457 1430 1430
query71 10480 10204 10199 10199
query72 4665 2795 2809 2795
query73 2063 315 308 308
query74 6871 6504 6453 6453
query75 4827 2354 2325 2325
query76 6680 1030 976 976
query77 836 228 233 228
query78 9008 8977 8708 8708
query79 986 498 503 498
query80 524 321 315 315
query81 449 203 203 203
query82 235 79 74 74
query83 142 118 119 118
query84 279 66 67 66
query85 1071 334 329 329
query86 390 386 374 374
query87 3498 3358 3325 3325
query88 2711 2196 2205 2196
query89 420 363 341 341
query90 2066 183 187 183
query91 161 117 120 117
query92 53 43 41 41
query93 921 413 441 413
query94 1183 159 158 158
query95 499 461 448 448
query96 614 312 315 312
query97 4263 4164 4134 4134
query98 209 194 185 185
query99 1035 733 709 709
Total cold run time: 302056 ms
Total hot run time: 186319 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1831557153
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903505753
<details>
<summary>TPC-H: <b>Total hot run time: 39166 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c4f17150568ba3f4d9516cb7b31cf70e389a4b23, data reload: false
------ Round 1 ----------------------------------
q1 17726 5271 5460 5271
q2 2810 153 143 143
q3 10980 1218 1198 1198
q4 10540 792 862 792
q5 7828 3285 3168 3168
q6 202 126 123 123
q7 886 531 494 494
q8 9264 1934 1950 1934
q9 7283 6378 6375 6375
q10 8194 3080 3088 3080
q11 417 208 216 208
q12 359 197 200 197
q13 17997 3386 3348 3348
q14 247 222 221 221
q15 544 524 505 505
q16 429 370 375 370
q17 956 576 507 507
q18 7562 6808 6952 6808
q19 1544 1415 1393 1393
q20 557 324 305 305
q21 2812 2422 2517 2422
q22 373 327 304 304
Total cold run time: 109510 ms
Total hot run time: 39166 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5430 5340 5365 5340
q2 325 213 204 204
q3 3316 3281 3260 3260
q4 2125 2069 2060 2060
q5 6088 5964 5838 5838
q6 196 116 116 116
q7 2327 1871 1878 1871
q8 3234 3379 3380 3379
q9 9043 9022 8760 8760
q10 3987 3821 3879 3821
q11 553 450 449 449
q12 829 631 640 631
q13 16952 3195 3125 3125
q14 282 257 267 257
q15 551 501 503 501
q16 533 464 466 464
q17 1942 1791 1842 1791
q18 9389 9499 10257 9499
q19 20550 1555 1522 1522
q20 4647 1935 1912 1912
q21 14151 5407 5391 5391
q22 998 549 516 516
Total cold run time: 107448 ms
Total hot run time: 60707 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903377343
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit dfa54e983fb06b412c4313334dbaf427f9cfad2d with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.2 seconds inserted 10000000 Rows, about 704K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1832598090
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 43.97 seconds
stream load tsv: 574 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17162702016 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903473716
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 2bb024e9677159eb913f4aa56c116014fe4cf1af with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 14.6 seconds inserted 10000000 Rows, about 684K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903328376
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1906053336
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit c22880621389cb371d5584e77361a94bba0b5922 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.8 seconds inserted 10000000 Rows, about 675K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1833209399
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.42 seconds
stream load tsv: 561 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.3 seconds inserted 10000000 Rows, about 341K ops/s
storage size: 17162800443 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1832996099
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903357559
<details>
<summary>TPC-H: <b>Total hot run time: 38963 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dfa54e983fb06b412c4313334dbaf427f9cfad2d, data reload: false
------ Round 1 ----------------------------------
q1 17657 5239 5278 5239
q2 2038 152 135 135
q3 10623 1137 1165 1137
q4 10220 742 858 742
q5 7730 3151 3220 3151
q6 196 121 122 121
q7 865 486 479 479
q8 9243 1916 1962 1916
q9 7258 6410 6355 6355
q10 8212 3060 3117 3060
q11 409 201 213 201
q12 353 192 200 192
q13 17992 3394 3346 3346
q14 254 225 239 225
q15 584 512 504 504
q16 433 373 366 366
q17 948 552 481 481
q18 7300 7018 6932 6932
q19 1609 1364 1384 1364
q20 612 309 304 304
q21 2777 2393 2463 2393
q22 379 324 320 320
Total cold run time: 107692 ms
Total hot run time: 38963 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5400 5406 5261 5261
q2 327 223 217 217
q3 3317 3258 3177 3177
q4 2081 2062 2055 2055
q5 5901 5938 5972 5938
q6 200 120 120 120
q7 2281 1803 1972 1803
q8 3240 3372 3398 3372
q9 8985 8864 8761 8761
q10 3925 3805 3852 3805
q11 562 471 471 471
q12 825 618 631 618
q13 16931 3190 3199 3190
q14 288 253 272 253
q15 553 513 510 510
q16 508 467 468 467
q17 1918 1852 1845 1845
q18 9428 16644 9566 9566
q19 24107 1524 1505 1505
q20 4613 1930 1925 1925
q21 14408 5368 5396 5368
q22 1002 546 506 506
Total cold run time: 110800 ms
Total hot run time: 60733 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903369029
<details>
<summary>TPC-DS: <b>Total hot run time: 176356 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dfa54e983fb06b412c4313334dbaf427f9cfad2d, data reload: false
query1 934 335 325 325
query2 6563 1964 1869 1869
query3 6705 203 200 200
query4 29144 22019 22505 22019
query5 4453 368 375 368
query6 244 152 154 152
query7 4612 257 266 257
query8 216 171 176 171
query9 8427 2544 2534 2534
query10 411 231 226 226
query11 16686 15567 15595 15567
query12 121 66 65 65
query13 1668 367 368 367
query14 10465 7095 6895 6895
query15 218 186 181 181
query16 5793 259 251 251
query17 964 472 475 472
query18 1781 256 249 249
query19 178 131 131 131
query20 68 76 69 69
query21 204 126 133 126
query22 4959 4773 4714 4714
query23 31579 30843 30788 30788
query24 7402 2868 2845 2845
query25 390 311 307 307
query26 801 144 145 144
query27 2504 283 286 283
query28 4047 1833 1812 1812
query29 909 638 617 617
query30 203 139 139 139
query31 928 756 766 756
query32 66 51 52 51
query33 420 216 211 211
query34 843 456 473 456
query35 871 748 783 748
query36 1325 1238 1230 1230
query37 93 60 62 60
query38 3344 3259 3214 3214
query39 1328 1276 1263 1263
query40 200 87 79 79
query41 38 38 35 35
query42 88 81 87 81
query43 514 483 473 473
query44 1021 688 693 688
query45 192 184 172 172
query46 1046 650 660 650
query47 1665 1553 1557 1553
query48 404 312 305 305
query49 623 288 284 284
query50 686 321 323 321
query51 5366 5256 5223 5223
query52 86 83 80 80
query53 329 253 252 252
query54 209 190 194 190
query55 89 79 75 75
query56 192 168 165 165
query57 999 929 940 929
query58 176 152 162 152
query59 2892 2612 2747 2612
query60 210 190 188 188
query61 80 80 79 79
query62 459 357 353 353
query63 295 264 265 264
query64 2547 1768 1765 1765
query65 3322 3289 3266 3266
query66 1156 319 306 306
query67 15595 15646 15027 15027
query68 10912 551 528 528
query69 603 304 289 289
query70 1624 1509 1473 1473
query71 492 214 214 214
query72 5055 2810 2847 2810
query73 2183 319 319 319
query74 7077 6441 6420 6420
query75 4908 2381 2279 2279
query76 6381 1029 1013 1013
query77 664 230 235 230
query78 9033 8745 8507 8507
query79 988 490 493 490
query80 582 316 313 313
query81 469 206 207 206
query82 204 78 79 78
query83 138 119 113 113
query84 275 70 68 68
query85 1077 341 321 321
query86 391 376 381 376
query87 3547 3369 3316 3316
query88 2789 2196 2182 2182
query89 431 350 352 350
query90 2241 192 185 185
query91 152 126 130 126
query92 52 45 50 45
query93 1131 424 443 424
query94 1467 156 158 156
query95 505 476 453 453
query96 616 314 323 314
query97 4238 4163 4208 4163
query98 201 193 192 192
query99 1042 704 715 704
Total cold run time: 273814 ms
Total hot run time: 176356 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on code in PR #27768:
URL: https://github.com/apache/doris/pull/27768#discussion_r1463174222
##########
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/physical/PhysicalTVFRelation.java:
##########
@@ -107,7 +107,7 @@ public String toString() {
public List<Slot> computeOutput() {
return function.getTable().getBaseSchema()
.stream()
- .map(col -> SlotReference.fromColumn(col, ImmutableList.of()))
+ .map(col -> SlotReference.fromColumn(col, ImmutableList.of(), null))
Review Comment:
fixed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1905900907
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1905900968
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1906048502
<details>
<summary>ClickBench: <b>Total hot run time: 30.99 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c22880621389cb371d5584e77361a94bba0b5922, data reload: false
query1 0.03 0.03 0.03
query2 0.06 0.03 0.03
query3 0.23 0.05 0.06
query4 1.68 0.07 0.07
query5 0.56 0.53 0.52
query6 1.33 0.62 0.62
query7 0.02 0.02 0.01
query8 0.04 0.03 0.02
query9 0.55 0.50 0.50
query10 0.56 0.55 0.57
query11 0.12 0.08 0.09
query12 0.11 0.10 0.09
query13 0.61 0.60 0.61
query14 0.79 0.80 0.78
query15 0.79 0.78 0.77
query16 0.39 0.39 0.38
query17 1.02 1.00 0.98
query18 0.25 0.24 0.25
query19 1.89 1.80 1.79
query20 0.01 0.01 0.01
query21 15.39 0.57 0.57
query22 2.93 2.80 2.31
query23 17.36 0.80 0.76
query24 2.60 1.03 0.79
query25 0.36 0.16 0.06
query26 0.55 0.14 0.14
query27 0.07 0.06 0.06
query28 11.56 0.78 0.75
query29 12.63 3.21 3.08
query30 0.57 0.48 0.49
query31 2.77 0.36 0.35
query32 3.34 0.48 0.48
query33 3.22 3.21 3.24
query34 15.78 4.34 4.26
query35 4.38 4.28 4.26
query36 1.10 1.06 1.07
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.03 0.01 0.02
query40 0.16 0.13 0.13
query41 0.08 0.01 0.02
query42 0.03 0.02 0.01
query43 0.03 0.02 0.01
Total cold run time: 106.09 s
Total hot run time: 30.99 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903534432
<details>
<summary>ClickBench: <b>Total hot run time: 31.5 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c4f17150568ba3f4d9516cb7b31cf70e389a4b23, data reload: false
query1 0.04 0.03 0.03
query2 0.06 0.03 0.02
query3 0.23 0.05 0.05
query4 1.70 0.06 0.08
query5 0.54 0.51 0.52
query6 1.26 0.65 0.63
query7 0.02 0.01 0.01
query8 0.03 0.02 0.02
query9 0.54 0.49 0.52
query10 0.56 0.55 0.57
query11 0.11 0.09 0.09
query12 0.11 0.09 0.08
query13 0.62 0.60 0.60
query14 0.80 0.81 0.80
query15 0.79 0.77 0.76
query16 0.36 0.40 0.37
query17 1.02 0.97 1.02
query18 0.23 0.25 0.25
query19 1.83 1.78 1.80
query20 0.01 0.01 0.01
query21 15.53 0.58 0.58
query22 2.32 2.15 2.18
query23 17.51 0.95 0.82
query24 2.73 1.47 1.27
query25 0.36 0.21 0.15
query26 0.56 0.14 0.13
query27 0.06 0.06 0.05
query28 10.14 0.78 0.75
query29 12.55 3.20 3.22
query30 0.57 0.49 0.48
query31 2.78 0.33 0.34
query32 3.36 0.48 0.48
query33 3.23 3.20 3.28
query34 15.94 4.26 4.24
query35 4.33 4.25 4.46
query36 1.10 1.08 1.08
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.03 0.02 0.01
query40 0.16 0.13 0.13
query41 0.07 0.02 0.01
query42 0.02 0.01 0.02
query43 0.02 0.02 0.02
Total cold run time: 104.34 s
Total hot run time: 31.5 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903445686
<details>
<summary>TPC-H: <b>Total hot run time: 39168 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2bb024e9677159eb913f4aa56c116014fe4cf1af, data reload: false
------ Round 1 ----------------------------------
q1 17601 5316 5290 5290
q2 2047 148 134 134
q3 10634 1197 1228 1197
q4 10528 820 784 784
q5 7820 3265 3197 3197
q6 209 122 127 122
q7 898 525 495 495
q8 9548 1933 2007 1933
q9 7575 6617 6403 6403
q10 8209 3116 3079 3079
q11 413 203 203 203
q12 356 192 193 192
q13 18018 3377 3368 3368
q14 254 212 211 211
q15 547 507 505 505
q16 427 374 367 367
q17 941 593 505 505
q18 7625 6836 6831 6831
q19 1579 1352 1437 1352
q20 595 304 273 273
q21 2772 2428 2427 2427
q22 403 300 305 300
Total cold run time: 108999 ms
Total hot run time: 39168 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5559 5344 5208 5208
q2 324 220 213 213
q3 3323 3253 3264 3253
q4 2102 2014 2077 2014
q5 6080 5968 6031 5968
q6 200 119 118 118
q7 2370 1827 1938 1827
q8 3218 3408 3434 3408
q9 8976 9090 8690 8690
q10 3955 3878 3845 3845
q11 568 482 469 469
q12 793 620 619 619
q13 16936 3204 3210 3204
q14 280 256 264 256
q15 551 511 501 501
q16 531 458 484 458
q17 1870 1831 1853 1831
q18 9491 16456 9467 9467
q19 27503 1650 1538 1538
q20 4579 1963 1945 1945
q21 14461 5436 5330 5330
q22 1007 579 520 520
Total cold run time: 114677 ms
Total hot run time: 60682 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903539965
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit c4f17150568ba3f4d9516cb7b31cf70e389a4b23 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.1 seconds inserted 10000000 Rows, about 709K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903374299
<details>
<summary>ClickBench: <b>Total hot run time: 30.77 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dfa54e983fb06b412c4313334dbaf427f9cfad2d, data reload: false
query1 0.04 0.03 0.02
query2 0.05 0.02 0.02
query3 0.23 0.05 0.05
query4 1.70 0.07 0.07
query5 0.54 0.52 0.52
query6 1.30 0.65 0.63
query7 0.02 0.01 0.01
query8 0.04 0.02 0.02
query9 0.56 0.50 0.52
query10 0.56 0.58 0.55
query11 0.12 0.10 0.09
query12 0.12 0.09 0.08
query13 0.61 0.62 0.60
query14 0.79 0.83 0.82
query15 0.77 0.77 0.76
query16 0.39 0.36 0.39
query17 1.01 1.02 0.99
query18 0.23 0.24 0.26
query19 1.82 1.80 1.77
query20 0.01 0.01 0.02
query21 15.40 0.56 0.57
query22 2.36 2.59 2.06
query23 17.39 0.79 0.70
query24 2.25 1.07 0.76
query25 0.35 0.23 0.16
query26 0.43 0.14 0.13
query27 0.05 0.06 0.05
query28 11.90 0.78 0.74
query29 12.48 3.20 3.10
query30 0.60 0.53 0.49
query31 2.79 0.35 0.34
query32 3.38 0.50 0.48
query33 3.25 3.22 3.29
query34 15.73 4.37 4.28
query35 4.37 4.29 4.28
query36 1.11 1.05 1.08
query37 0.06 0.06 0.06
query38 0.04 0.03 0.02
query39 0.02 0.01 0.02
query40 0.16 0.13 0.13
query41 0.06 0.01 0.02
query42 0.02 0.01 0.01
query43 0.03 0.02 0.02
Total cold run time: 105.14 s
Total hot run time: 30.77 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1832402148
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1833370770
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1832195362
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903461292
<details>
<summary>TPC-DS: <b>Total hot run time: 177559 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2bb024e9677159eb913f4aa56c116014fe4cf1af, data reload: false
query1 950 340 336 336
query2 6528 2024 2022 2022
query3 6699 202 199 199
query4 30612 22231 22154 22154
query5 4455 435 454 435
query6 247 155 147 147
query7 4629 259 258 258
query8 228 178 178 178
query9 8393 2555 2531 2531
query10 426 226 240 226
query11 16760 15713 15563 15563
query12 120 73 66 66
query13 1694 383 381 381
query14 10530 6980 6945 6945
query15 219 181 183 181
query16 5801 258 261 258
query17 935 467 475 467
query18 1780 257 259 257
query19 179 136 128 128
query20 70 68 67 67
query21 179 125 127 125
query22 4924 4778 4769 4769
query23 31713 30935 31071 30935
query24 12607 2803 2826 2803
query25 565 314 314 314
query26 1790 143 138 138
query27 3213 286 293 286
query28 7378 1829 1825 1825
query29 2151 627 639 627
query30 283 136 143 136
query31 931 744 760 744
query32 82 49 49 49
query33 715 218 219 218
query34 1133 463 473 463
query35 872 757 767 757
query36 1288 1181 1204 1181
query37 91 63 59 59
query38 3390 3226 3201 3201
query39 1323 1277 1275 1275
query40 344 88 86 86
query41 37 35 36 35
query42 89 85 83 83
query43 534 492 510 492
query44 1092 695 692 692
query45 197 183 179 179
query46 1074 657 661 657
query47 1659 1580 1607 1580
query48 402 311 313 311
query49 1217 288 282 282
query50 685 315 317 315
query51 5331 5213 5252 5213
query52 90 83 79 79
query53 337 258 254 254
query54 245 184 193 184
query55 80 79 78 78
query56 182 170 159 159
query57 1082 882 923 882
query58 193 163 168 163
query59 3012 2919 2923 2919
query60 211 180 184 180
query61 83 106 80 80
query62 643 380 376 376
query63 293 265 266 265
query64 6102 1771 1761 1761
query65 3355 3264 3249 3249
query66 1439 314 326 314
query67 15625 14885 15233 14885
query68 12312 551 517 517
query69 602 298 305 298
query70 1675 1472 1521 1472
query71 511 215 215 215
query72 4879 2819 2847 2819
query73 2731 315 313 313
query74 6956 6349 6412 6349
query75 5097 2317 2313 2313
query76 6539 1068 1015 1015
query77 646 234 235 234
query78 9073 8834 8842 8834
query79 1002 503 502 502
query80 580 323 312 312
query81 446 208 203 203
query82 208 82 80 80
query83 137 116 117 116
query84 269 71 68 68
query85 1113 326 335 326
query86 387 416 366 366
query87 3524 3368 3379 3368
query88 2815 2215 2207 2207
query89 439 367 365 365
query90 2016 183 185 183
query91 155 129 124 124
query92 55 44 46 44
query93 1365 464 456 456
query94 1214 160 160 160
query95 503 469 451 451
query96 614 323 328 323
query97 4308 4171 4172 4171
query98 212 199 193 193
query99 1094 743 705 705
Total cold run time: 294993 ms
Total hot run time: 177559 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1905965766
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1906020454
<details>
<summary>TPC-H: <b>Total hot run time: 38453 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c22880621389cb371d5584e77361a94bba0b5922, data reload: false
------ Round 1 ----------------------------------
q1 17689 5152 5330 5152
q2 2041 138 129 129
q3 10647 1145 1136 1136
q4 10249 771 805 771
q5 7720 3134 3107 3107
q6 202 120 119 119
q7 842 482 474 474
q8 9240 1912 1943 1912
q9 7212 6358 6328 6328
q10 8186 3054 3009 3009
q11 408 202 204 202
q12 351 185 184 184
q13 17992 3333 3360 3333
q14 242 207 200 200
q15 542 498 503 498
q16 422 374 380 374
q17 938 513 500 500
q18 7497 6907 6702 6702
q19 1546 1324 1431 1324
q20 585 311 285 285
q21 2761 2445 2397 2397
q22 376 317 324 317
Total cold run time: 107688 ms
Total hot run time: 38453 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5658 5220 5348 5220
q2 331 225 217 217
q3 3337 3249 3269 3249
q4 2100 2072 2026 2026
q5 6071 5964 5931 5931
q6 195 118 119 118
q7 2361 1904 1890 1890
q8 3237 3374 3389 3374
q9 9018 8990 8864 8864
q10 4234 3995 4000 3995
q11 582 476 471 471
q12 875 660 640 640
q13 17154 3423 3432 3423
q14 455 271 288 271
q15 592 542 538 538
q16 552 542 539 539
q17 2748 1812 1862 1812
q18 10333 17340 9600 9600
q19 22936 1571 1523 1523
q20 4676 1967 1951 1951
q21 14897 5276 5425 5276
q22 1133 567 588 567
Total cold run time: 113475 ms
Total hot run time: 61495 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1832164177
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1833031969
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1833575867
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit e13e016c814f64b7bcd9df79f94655a29ff2edf3, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4942 4719 4691 4691
q2 350 169 158 158
q3 1519 1288 1312 1288
q4 1167 955 976 955
q5 3288 3267 3251 3251
q6 258 136 137 136
q7 1029 512 593 512
q8 2233 2266 2240 2240
q9 7010 7203 6997 6997
q10 3406 3393 3402 3393
q11 348 206 212 206
q12 361 220 220 220
q13 4648 3913 3928 3913
q14 244 220 208 208
q15 589 541 526 526
q16 422 394 411 394
q17 1062 674 571 571
q18 8059 7598 8182 7598
q19 1561 1559 1569 1559
q20 609 331 835 331
q21 3506 3041 2992 2992
q22 375 307 315 307
Total cold run time: 46986 ms
Total hot run time: 42446 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4591 4624 4579 4579
q2 330 210 229 210
q3 3753 3752 3749 3749
q4 2554 2534 2539 2534
q5 6209 6202 6207 6202
q6 256 128 133 128
q7 2620 1980 1998 1980
q8 3763 3718 3728 3718
q9 9376 9369 9386 9369
q10 4065 4156 4175 4156
q11 666 514 509 509
q12 832 608 638 608
q13 4384 3615 3676 3615
q14 285 261 251 251
q15 591 533 530 530
q16 529 492 514 492
q17 2163 2107 2112 2107
q18 9505 8965 9101 8965
q19 1836 1805 1785 1785
q20 2313 1992 1977 1977
q21 7547 7093 7313 7093
q22 655 583 572 572
Total cold run time: 68823 ms
Total hot run time: 65129 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1833775776
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 7be41d0a5d32fc419659e507c03168cd2f636422, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4899 4679 4659 4659
q2 353 162 159 159
q3 1514 1312 1304 1304
q4 1137 943 944 943
q5 3235 3229 3215 3215
q6 251 129 129 129
q7 1020 514 546 514
q8 2263 2230 2217 2217
q9 6956 6912 6976 6912
q10 3285 3386 3368 3368
q11 336 211 212 211
q12 366 222 210 210
q13 4642 3869 3898 3869
q14 262 213 222 213
q15 595 529 526 526
q16 440 402 382 382
q17 1026 688 625 625
q18 8146 9051 7517 7517
q19 1563 1557 1545 1545
q20 540 344 309 309
q21 3399 2986 2968 2968
q22 364 301 303 301
Total cold run time: 46592 ms
Total hot run time: 42096 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4582 4584 4694 4584
q2 354 239 237 237
q3 3746 3751 3756 3751
q4 2514 2502 2489 2489
q5 6198 6173 6185 6173
q6 247 118 119 118
q7 2592 1996 1986 1986
q8 3680 3697 3664 3664
q9 9522 9408 9390 9390
q10 4053 4155 4145 4145
q11 629 524 528 524
q12 803 622 622 622
q13 4369 3617 3624 3617
q14 281 244 249 244
q15 588 529 520 520
q16 500 479 497 479
q17 2079 2081 2121 2081
q18 9632 9009 8927 8927
q19 1767 1778 1786 1778
q20 2290 1981 1968 1968
q21 7391 7217 7107 7107
q22 620 550 587 550
Total cold run time: 68437 ms
Total hot run time: 64954 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903525624
<details>
<summary>TPC-DS: <b>Total hot run time: 176781 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c4f17150568ba3f4d9516cb7b31cf70e389a4b23, data reload: false
query1 949 341 332 332
query2 6547 2125 2046 2046
query3 6694 198 198 198
query4 30052 22123 22284 22123
query5 4454 360 373 360
query6 263 164 158 158
query7 4600 265 259 259
query8 225 167 174 167
query9 8367 2541 2505 2505
query10 410 221 227 221
query11 16998 15556 15475 15475
query12 122 68 66 66
query13 1690 373 370 370
query14 10446 6975 6867 6867
query15 213 182 191 182
query16 5790 255 255 255
query17 946 481 471 471
query18 1783 249 249 249
query19 185 133 131 131
query20 74 68 72 68
query21 190 134 130 130
query22 4944 4844 4687 4687
query23 31642 30921 30822 30822
query24 12599 2817 2810 2810
query25 566 320 303 303
query26 1821 141 138 138
query27 3233 289 291 289
query28 7077 1831 1817 1817
query29 2184 638 621 621
query30 286 135 137 135
query31 926 740 734 734
query32 90 53 51 51
query33 713 213 212 212
query34 1169 449 460 449
query35 863 762 754 754
query36 1309 1207 1209 1207
query37 178 58 58 58
query38 3372 3245 3219 3219
query39 1316 1268 1258 1258
query40 357 86 80 80
query41 38 36 34 34
query42 92 80 84 80
query43 528 527 471 471
query44 1063 688 686 686
query45 195 179 178 178
query46 1055 651 647 647
query47 1675 1592 1591 1591
query48 398 314 311 311
query49 1220 287 277 277
query50 681 308 308 308
query51 5302 5163 5181 5163
query52 89 84 81 81
query53 329 251 255 251
query54 239 179 181 179
query55 88 75 75 75
query56 181 165 167 165
query57 1039 933 931 931
query58 194 168 163 163
query59 2855 2818 2817 2817
query60 206 184 182 182
query61 83 89 85 85
query62 634 362 356 356
query63 281 256 257 256
query64 6169 1791 1786 1786
query65 3313 3245 3245 3245
query66 1432 322 318 318
query67 15470 15213 15095 15095
query68 10453 531 505 505
query69 605 307 297 297
query70 1684 1442 1435 1435
query71 553 214 230 214
query72 4628 2827 2822 2822
query73 1922 316 315 315
query74 7022 6382 6381 6381
query75 4884 2340 2312 2312
query76 6678 1001 1025 1001
query77 845 228 234 228
query78 9541 8840 8643 8643
query79 1086 503 502 502
query80 639 324 310 310
query81 452 202 204 202
query82 216 84 77 77
query83 142 120 119 119
query84 277 68 68 68
query85 1109 334 328 328
query86 371 375 386 375
query87 3551 3334 3339 3334
query88 3312 2187 2184 2184
query89 435 369 365 365
query90 2093 184 180 180
query91 151 132 134 132
query92 56 44 45 44
query93 3410 455 454 454
query94 1248 157 154 154
query95 492 451 454 451
query96 612 310 316 310
query97 4273 4177 4131 4131
query98 198 189 183 183
query99 1077 725 717 717
Total cold run time: 294507 ms
Total hot run time: 176781 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903469238
<details>
<summary>ClickBench: <b>Total hot run time: 30.3 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2bb024e9677159eb913f4aa56c116014fe4cf1af, data reload: false
query1 0.03 0.02 0.03
query2 0.06 0.02 0.03
query3 0.22 0.05 0.05
query4 1.70 0.07 0.07
query5 0.54 0.53 0.52
query6 1.23 0.63 0.62
query7 0.02 0.01 0.01
query8 0.03 0.02 0.02
query9 0.55 0.50 0.51
query10 0.56 0.56 0.55
query11 0.12 0.08 0.08
query12 0.12 0.09 0.08
query13 0.60 0.62 0.60
query14 0.77 0.79 0.81
query15 0.80 0.79 0.78
query16 0.36 0.37 0.39
query17 0.99 1.05 1.01
query18 0.23 0.25 0.25
query19 1.87 1.75 1.80
query20 0.01 0.02 0.01
query21 15.43 0.58 0.60
query22 3.16 2.32 1.72
query23 17.47 0.80 0.79
query24 2.34 1.64 0.54
query25 0.37 0.16 0.09
query26 0.62 0.13 0.13
query27 0.05 0.06 0.04
query28 11.27 0.78 0.76
query29 12.58 3.18 3.21
query30 0.53 0.49 0.47
query31 2.78 0.34 0.33
query32 3.39 0.48 0.49
query33 3.26 3.23 3.23
query34 15.76 4.26 4.30
query35 4.33 4.27 4.27
query36 1.11 1.08 1.07
query37 0.06 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.01 0.02
query40 0.15 0.12 0.14
query41 0.07 0.02 0.01
query42 0.03 0.02 0.02
query43 0.02 0.02 0.02
Total cold run time: 105.65 s
Total hot run time: 30.3 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903476847
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1903414279
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon commented on PR #27768:
URL: https://github.com/apache/doris/pull/27768#issuecomment-1895275221
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Nereids](Variant) Implement variant type in Variant and support new sub column access method [doris]
Posted by "eldenmoon (via GitHub)" <gi...@apache.org>.
eldenmoon closed pull request #27768: [Nereids](Variant) Implement variant type in Variant and support new sub column access method
URL: https://github.com/apache/doris/pull/27768
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org