You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "AshinGau (via GitHub)" <gi...@apache.org> on 2024/03/11 05:25:52 UTC
[PR] [feature](hudi) support incremental read for hudi table [doris]
AshinGau opened a new pull request, #32052:
URL: https://github.com/apache/doris/pull/32052
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1991184683
<details>
<summary>ClickBench: <b>Total hot run time: 30.1 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 168b5c6882498ed302ee1fca779228f829e6d463, data reload: false
query1 0.04 0.04 0.03
query2 0.06 0.03 0.03
query3 0.23 0.06 0.06
query4 1.67 0.09 0.09
query5 0.52 0.52 0.52
query6 1.20 0.62 0.64
query7 0.01 0.02 0.01
query8 0.04 0.03 0.03
query9 0.58 0.50 0.49
query10 0.56 0.55 0.54
query11 0.12 0.09 0.09
query12 0.11 0.09 0.09
query13 0.57 0.56 0.56
query14 0.72 0.75 0.74
query15 0.81 0.78 0.80
query16 0.40 0.40 0.39
query17 1.03 0.97 0.99
query18 0.20 0.26 0.23
query19 1.72 1.79 1.76
query20 0.01 0.00 0.00
query21 15.41 0.57 0.54
query22 2.43 1.72 2.18
query23 17.34 0.75 0.75
query24 3.22 0.81 1.00
query25 0.05 0.15 0.04
query26 0.69 0.13 0.13
query27 0.03 0.03 0.03
query28 11.62 0.85 0.84
query29 12.52 3.26 3.26
query30 0.64 0.62 0.54
query31 2.83 0.33 0.34
query32 3.39 0.45 0.44
query33 2.85 2.78 2.81
query34 16.04 4.32 4.37
query35 4.35 4.29 4.26
query36 1.09 1.00 1.02
query37 0.06 0.05 0.06
query38 0.04 0.04 0.03
query39 0.03 0.02 0.02
query40 0.17 0.13 0.15
query41 0.06 0.02 0.02
query42 0.02 0.01 0.02
query43 0.03 0.02 0.03
Total cold run time: 105.51 s
Total hot run time: 30.1 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1991139420
<details>
<summary>TPC-H: <b>Total hot run time: 36549 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 168b5c6882498ed302ee1fca779228f829e6d463, data reload: false
------ Round 1 ----------------------------------
q1 17727 4225 4085 4085
q2 2023 146 138 138
q3 10591 901 909 901
q4 4666 782 689 689
q5 7762 2794 2800 2794
q6 183 120 119 119
q7 1201 835 794 794
q8 9474 1995 2035 1995
q9 7291 6452 6479 6452
q10 8163 2546 2465 2465
q11 418 218 213 213
q12 777 307 280 280
q13 17949 2981 2973 2973
q14 270 258 255 255
q15 489 457 450 450
q16 487 389 388 388
q17 943 520 608 520
q18 6481 5931 5812 5812
q19 1579 1482 1402 1402
q20 552 279 295 279
q21 7340 3300 3247 3247
q22 775 298 300 298
Total cold run time: 107141 ms
Total hot run time: 36549 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4114 4077 4120 4077
q2 319 223 226 223
q3 2996 2832 2869 2832
q4 1845 1619 1551 1551
q5 5199 5225 5219 5219
q6 201 123 122 122
q7 2235 1830 1854 1830
q8 3167 3282 3285 3282
q9 8518 8516 8528 8516
q10 6182 3665 3662 3662
q11 526 436 448 436
q12 730 560 516 516
q13 7250 2833 2828 2828
q14 269 241 247 241
q15 488 446 446 446
q16 440 403 407 403
q17 1715 1478 1468 1468
q18 7582 7117 7076 7076
q19 6056 1527 1485 1485
q20 1921 1723 1700 1700
q21 4909 4719 4722 4719
q22 548 470 450 450
Total cold run time: 67210 ms
Total hot run time: 53082 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "AshinGau (via GitHub)" <gi...@apache.org>.
AshinGau commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1993468965
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "AshinGau (via GitHub)" <gi...@apache.org>.
AshinGau commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1991092042
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1991190734
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 168b5c6882498ed302ee1fca779228f829e6d463 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 16.2 seconds inserted 10000000 Rows, about 617K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1993509801
<details>
<summary>TPC-H: <b>Total hot run time: 36854 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1c72219f21dae7b6d9a66b4324bf8b6e1c025125, data reload: false
------ Round 1 ----------------------------------
q1 18226 4460 4167 4167
q2 2416 150 146 146
q3 11238 941 920 920
q4 5355 718 758 718
q5 7915 2727 2712 2712
q6 195 129 124 124
q7 1235 832 823 823
q8 9994 2150 2089 2089
q9 7598 6468 6457 6457
q10 8154 2510 2500 2500
q11 424 223 217 217
q12 781 291 294 291
q13 17980 3043 3046 3043
q14 280 269 249 249
q15 497 452 459 452
q16 476 395 402 395
q17 938 527 617 527
q18 6762 5857 5816 5816
q19 1569 1399 1412 1399
q20 565 308 269 269
q21 7363 3347 3245 3245
q22 796 319 295 295
Total cold run time: 110757 ms
Total hot run time: 36854 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4084 4123 4064 4064
q2 314 227 221 221
q3 2957 2875 2785 2785
q4 1838 1575 1527 1527
q5 5199 5231 5236 5231
q6 188 128 121 121
q7 2208 1836 1801 1801
q8 3144 3306 3280 3280
q9 8520 8494 8529 8494
q10 6130 3642 3652 3642
q11 526 436 445 436
q12 734 537 542 537
q13 11769 2851 2849 2849
q14 283 239 262 239
q15 472 446 446 446
q16 441 383 410 383
q17 1727 1457 1449 1449
q18 7691 7068 7062 7062
q19 1605 1502 1494 1494
q20 1871 1719 1741 1719
q21 4740 4745 4699 4699
q22 535 458 451 451
Total cold run time: 66976 ms
Total hot run time: 52930 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1993540212
<details>
<summary>TPC-DS: <b>Total hot run time: 187039 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1c72219f21dae7b6d9a66b4324bf8b6e1c025125, data reload: false
query1 922 365 334 334
query2 7404 1995 2074 1995
query3 6709 213 211 211
query4 31045 20583 20518 20518
query5 4362 472 393 393
query6 260 176 177 176
query7 4627 309 285 285
query8 227 170 180 170
query9 9920 2291 2256 2256
query10 452 232 233 232
query11 17259 14032 14000 14000
query12 134 100 86 86
query13 1645 424 441 424
query14 11590 10548 10910 10548
query15 286 212 197 197
query16 8036 260 257 257
query17 1944 569 544 544
query18 2078 286 278 278
query19 263 158 157 157
query20 89 82 89 82
query21 202 133 122 122
query22 4682 4505 4520 4505
query23 31722 31177 31176 31176
query24 10774 2853 2837 2837
query25 623 382 406 382
query26 1364 160 160 160
query27 2995 354 360 354
query28 7964 1846 1841 1841
query29 887 648 633 633
query30 310 149 147 147
query31 956 702 719 702
query32 90 57 59 57
query33 765 259 250 250
query34 1063 462 462 462
query35 870 607 603 603
query36 986 879 873 873
query37 110 75 77 75
query38 3256 3179 3156 3156
query39 1416 1368 1394 1368
query40 204 111 113 111
query41 49 47 47 47
query42 102 97 96 96
query43 484 456 456 456
query44 1330 725 695 695
query45 265 258 247 247
query46 1081 695 693 693
query47 1655 1587 1593 1587
query48 429 376 343 343
query49 1135 351 357 351
query50 768 373 377 373
query51 6882 6753 6782 6753
query52 100 94 91 91
query53 344 271 273 271
query54 296 246 234 234
query55 82 78 80 78
query56 243 242 232 232
query57 1103 1020 997 997
query58 240 205 211 205
query59 2677 2572 2491 2491
query60 260 264 262 262
query61 114 117 113 113
query62 633 402 394 394
query63 312 274 274 274
query64 6173 3843 3901 3843
query65 3103 3026 2996 2996
query66 1405 328 342 328
query67 15009 14519 14369 14369
query68 8996 536 531 531
query69 632 375 379 375
query70 1320 1122 1182 1122
query71 568 282 279 279
query72 6402 2696 2554 2554
query73 1489 320 326 320
query74 8464 6590 6593 6590
query75 9651 7965 8034 7965
query76 5344 939 896 896
query77 653 265 260 260
query78 10361 9689 9614 9614
query79 12807 531 515 515
query80 1747 377 419 377
query81 517 217 206 206
query82 823 202 198 198
query83 216 150 149 149
query84 284 77 77 77
query85 1467 336 320 320
query86 414 318 308 308
query87 3404 3224 3199 3199
query88 5076 2290 2273 2273
query89 524 356 356 356
query90 2009 173 175 173
query91 162 127 125 125
query92 62 47 50 47
query93 7199 506 486 486
query94 1190 175 173 173
query95 429 338 321 321
query96 595 274 265 265
query97 4404 4238 4289 4238
query98 227 214 207 207
query99 1265 751 744 744
Total cold run time: 325466 ms
Total hot run time: 187039 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support incremental read for hudi table [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1987657291
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman commented on code in PR #32052:
URL: https://github.com/apache/doris/pull/32052#discussion_r1519184807
##########
fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HMSExternalTable.java:
##########
@@ -282,6 +304,82 @@ public List<Column> getPartitionColumns() {
return partitionColumns;
}
+ public TableScanParams getScanParams() {
+ return scanParams;
+ }
+
+ public void setScanParams(TableScanParams scanParams) {
+ if (scanParams != null && "incr".equals(scanParams.getParamType())) {
Review Comment:
define the `incr` value somewhere
##########
fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HMSExternalTable.java:
##########
@@ -225,7 +244,10 @@ public boolean isHoodieCowTable() {
return false;
}
String inputFormatName = remoteTable.getSd().getInputFormat();
- return "org.apache.hudi.hadoop.HoodieParquetInputFormat".equals(inputFormatName);
+ Map<String, String> paras = remoteTable.getParameters();
Review Comment:
```suggestion
Map<String, String> params = remoteTable.getParameters();
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1993554254
<details>
<summary>ClickBench: <b>Total hot run time: 30.45 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1c72219f21dae7b6d9a66b4324bf8b6e1c025125, data reload: false
query1 0.04 0.03 0.03
query2 0.05 0.02 0.02
query3 0.23 0.06 0.06
query4 1.69 0.10 0.10
query5 0.50 0.47 0.49
query6 1.21 0.62 0.62
query7 0.01 0.01 0.02
query8 0.05 0.03 0.03
query9 0.54 0.49 0.51
query10 0.54 0.54 0.52
query11 0.11 0.09 0.09
query12 0.12 0.09 0.09
query13 0.56 0.56 0.56
query14 0.75 0.74 0.75
query15 0.78 0.77 0.79
query16 0.39 0.39 0.40
query17 0.97 1.02 1.02
query18 0.20 0.25 0.21
query19 1.85 1.63 1.65
query20 0.02 0.01 0.01
query21 15.41 0.58 0.56
query22 2.72 2.10 1.53
query23 17.21 0.80 0.73
query24 3.15 2.30 1.48
query25 0.14 0.10 0.13
query26 0.71 0.12 0.11
query27 0.03 0.03 0.03
query28 9.84 0.90 0.85
query29 12.58 3.29 3.15
query30 0.71 0.61 0.63
query31 2.81 0.33 0.34
query32 3.40 0.43 0.44
query33 2.76 2.80 2.79
query34 16.07 4.28 4.28
query35 4.32 4.34 4.35
query36 1.07 0.99 1.01
query37 0.07 0.06 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.02
query40 0.18 0.14 0.13
query41 0.07 0.03 0.02
query42 0.03 0.02 0.01
query43 0.03 0.02 0.02
Total cold run time: 103.98 s
Total hot run time: 30.45 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1993561969
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 1c72219f21dae7b6d9a66b4324bf8b6e1c025125 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.7 seconds inserted 10000000 Rows, about 729K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1996298039
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1996298063
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32052:
URL: https://github.com/apache/doris/pull/32052#issuecomment-1991171773
<details>
<summary>TPC-DS: <b>Total hot run time: 186499 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 168b5c6882498ed302ee1fca779228f829e6d463, data reload: false
query1 912 355 342 342
query2 7725 2064 1965 1965
query3 6718 217 207 207
query4 31402 20532 20591 20532
query5 4309 414 427 414
query6 271 171 167 167
query7 4639 302 288 288
query8 227 173 165 165
query9 9945 2322 2303 2303
query10 450 241 242 241
query11 14657 14063 14115 14063
query12 130 83 112 83
query13 1622 420 425 420
query14 11722 10400 10520 10400
query15 270 211 194 194
query16 7915 265 266 265
query17 1937 580 549 549
query18 2057 290 290 290
query19 208 150 163 150
query20 92 83 84 83
query21 196 135 124 124
query22 4676 4468 4437 4437
query23 31679 30946 31173 30946
query24 12215 2862 2829 2829
query25 688 384 377 377
query26 1893 160 166 160
query27 3283 360 361 360
query28 8181 1902 1909 1902
query29 1050 650 613 613
query30 312 148 161 148
query31 959 725 729 725
query32 97 71 53 53
query33 775 262 254 254
query34 1120 462 474 462
query35 840 620 609 609
query36 1006 904 846 846
query37 272 79 75 75
query38 3291 3140 3110 3110
query39 1401 1361 1460 1361
query40 292 110 111 110
query41 52 48 47 47
query42 101 115 97 97
query43 491 457 456 456
query44 1197 727 713 713
query45 268 266 252 252
query46 1068 679 683 679
query47 1678 1578 1613 1578
query48 459 385 355 355
query49 1225 326 406 326
query50 752 370 374 370
query51 6631 6626 6541 6541
query52 94 95 85 85
query53 338 267 277 267
query54 322 237 238 237
query55 79 80 78 78
query56 242 219 216 216
query57 1098 1018 1002 1002
query58 216 193 222 193
query59 2788 2657 2687 2657
query60 259 234 238 234
query61 94 106 96 96
query62 585 409 412 409
query63 295 273 269 269
query64 6218 3855 3724 3724
query65 3099 3017 2985 2985
query66 1391 351 322 322
query67 14618 14225 14473 14225
query68 6878 529 528 528
query69 619 378 377 377
query70 1242 1161 1187 1161
query71 512 264 279 264
query72 6476 2664 2600 2600
query73 728 323 330 323
query74 6881 6579 6576 6576
query75 9297 8153 7916 7916
query76 4925 950 1021 950
query77 648 283 259 259
query78 10132 9560 9607 9560
query79 8401 530 531 530
query80 1627 390 396 390
query81 512 220 207 207
query82 768 203 200 200
query83 216 147 153 147
query84 294 84 87 84
query85 1576 376 353 353
query86 471 293 297 293
query87 3454 3226 3204 3204
query88 5131 2359 2365 2359
query89 513 370 364 364
query90 1996 182 181 181
query91 158 127 149 127
query92 55 46 45 45
query93 6999 517 496 496
query94 1142 177 177 177
query95 435 337 328 328
query96 595 271 278 271
query97 4427 4239 4255 4239
query98 220 207 204 204
query99 1249 754 751 751
Total cold run time: 315669 ms
Total hot run time: 186499 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](hudi) support hudi incremental read [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #32052:
URL: https://github.com/apache/doris/pull/32052
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org