You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "liaoxin01 (via GitHub)" <gi...@apache.org> on 2024/03/04 13:02:11 UTC
[PR] [fix](load) fix npe on loadTxn2PCImpl [doris]
liaoxin01 opened a new pull request, #31753:
URL: https://github.com/apache/doris/pull/31753
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](load) fix npe on loadTxn2PCImpl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31753:
URL: https://github.com/apache/doris/pull/31753#issuecomment-1976633286
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 963dc97fc9fe0b749d4d5a4bbc27eb927528421c with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 20.6 seconds inserted 10000000 Rows, about 485K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](load) fix npe on loadTxn2PCImpl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31753:
URL: https://github.com/apache/doris/pull/31753#issuecomment-1976616761
<details>
<summary>TPC-DS: <b>Total hot run time: 201114 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 963dc97fc9fe0b749d4d5a4bbc27eb927528421c, data reload: false
query1 920 385 378 378
query2 6534 2252 1985 1985
query3 6912 203 205 203
query4 20742 18004 18098 18004
query5 19706 6488 6459 6459
query6 401 212 223 212
query7 5009 289 295 289
query8 241 239 220 220
query9 3103 2654 2601 2601
query10 439 300 296 296
query11 11323 10607 10592 10592
query12 121 72 72 72
query13 5589 644 647 644
query14 19461 13299 13795 13299
query15 346 227 235 227
query16 6423 259 257 257
query17 1354 1522 884 884
query18 2263 401 402 401
query19 209 146 137 137
query20 81 77 73 73
query21 188 89 96 89
query22 5019 4999 5141 4999
query23 32561 31844 31694 31694
query24 6720 6434 6517 6434
query25 521 453 404 404
query26 457 160 154 154
query27 1248 291 289 289
query28 6128 2234 2227 2227
query29 2925 2807 2798 2798
query30 240 165 162 162
query31 862 740 760 740
query32 65 61 52 52
query33 330 241 242 241
query34 826 469 464 464
query35 1109 898 928 898
query36 1670 1387 1487 1387
query37 92 56 58 56
query38 3079 2937 2904 2904
query39 1372 1316 1301 1301
query40 201 93 95 93
query41 35 33 31 31
query42 89 86 81 81
query43 674 576 554 554
query44 1078 717 708 708
query45 255 229 230 229
query46 1223 967 960 960
query47 1791 1693 1722 1693
query48 955 674 647 647
query49 619 370 365 365
query50 860 656 617 617
query51 4779 4618 4697 4618
query52 85 83 79 79
query53 435 317 314 314
query54 2637 2477 2462 2462
query55 93 82 85 82
query56 202 207 206 206
query57 1240 1130 1158 1130
query58 206 199 197 197
query59 3428 3334 3097 3097
query60 203 184 189 184
query61 80 79 77 77
query62 768 459 467 459
query63 475 331 332 331
query64 2157 1417 1371 1371
query65 3594 3574 3507 3507
query66 763 377 369 369
query67 16293 15473 15420 15420
query68 8735 665 664 664
query69 580 328 324 324
query70 2047 1733 1607 1607
query71 402 307 310 307
query72 6432 3451 3402 3402
query73 729 316 323 316
query74 6280 5812 5771 5771
query75 5146 3712 3670 3670
query76 5115 1187 1203 1187
query77 877 247 249 247
query78 12331 11493 11618 11493
query79 7624 618 638 618
query80 1005 396 395 395
query81 480 226 232 226
query82 1639 94 99 94
query83 156 137 130 130
query84 250 67 67 67
query85 810 279 273 273
query86 400 362 382 362
query87 3250 3060 3018 3018
query88 4925 2312 2329 2312
query89 359 315 285 285
query90 1930 213 211 211
query91 150 123 115 115
query92 53 53 52 52
query93 3871 562 552 552
query94 723 193 204 193
query95 1111 1069 1042 1042
query96 649 329 317 317
query97 6393 6431 6411 6411
query98 176 174 177 174
query99 2965 894 872 872
Total cold run time: 309400 ms
Total hot run time: 201114 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](load) fix npe on loadTxn2PCImpl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31753:
URL: https://github.com/apache/doris/pull/31753#issuecomment-1976593222
<details>
<summary>TPC-H: <b>Total hot run time: 49918 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 963dc97fc9fe0b749d4d5a4bbc27eb927528421c, data reload: false
------ Round 1 ----------------------------------
q1 18348 4389 4341 4341
q2 2033 150 140 140
q3 10483 1877 1913 1877
q4 10308 1247 1325 1247
q5 8468 4186 4007 4007
q6 233 122 123 122
q7 1999 1573 1600 1573
q8 9504 2674 2700 2674
q9 11503 10441 10451 10441
q10 8667 3511 3506 3506
q11 413 246 240 240
q12 461 303 301 301
q13 18351 3935 4010 3935
q14 347 323 321 321
q15 505 456 457 456
q16 674 581 580 580
q17 1107 944 966 944
q18 7243 6923 6899 6899
q19 1697 1581 1568 1568
q20 541 299 313 299
q21 4399 4049 4065 4049
q22 500 398 403 398
Total cold run time: 117784 ms
Total hot run time: 49918 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4326 4304 4271 4271
q2 312 219 219 219
q3 4172 4164 4132 4132
q4 2722 2731 2750 2731
q5 7226 7127 7213 7127
q6 239 119 119 119
q7 3288 2885 2878 2878
q8 4325 4404 4494 4404
q9 17030 17054 17108 17054
q10 4202 4321 4237 4237
q11 752 677 677 677
q12 1022 831 854 831
q13 7083 3888 3891 3888
q14 468 447 451 447
q15 502 465 458 458
q16 796 748 764 748
q17 3879 3938 3937 3937
q18 8937 8973 8838 8838
q19 1725 1692 1668 1668
q20 2372 2124 2169 2124
q21 8350 8449 8431 8431
q22 1005 978 946 946
Total cold run time: 84733 ms
Total hot run time: 80165 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](load) fix npe on loadTxn2PCImpl [doris]
Posted by "liaoxin01 (via GitHub)" <gi...@apache.org>.
liaoxin01 commented on PR #31753:
URL: https://github.com/apache/doris/pull/31753#issuecomment-1976539691
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](load) fix npe on loadTxn2PCImpl [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #31753:
URL: https://github.com/apache/doris/pull/31753
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](load) fix npe on loadTxn2PCImpl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31753:
URL: https://github.com/apache/doris/pull/31753#issuecomment-1976535247
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](load) fix npe on loadTxn2PCImpl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31753:
URL: https://github.com/apache/doris/pull/31753#issuecomment-1976627114
<details>
<summary>ClickBench: <b>Total hot run time: 30.84 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 963dc97fc9fe0b749d4d5a4bbc27eb927528421c, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.02 0.02
query3 0.24 0.04 0.05
query4 1.84 0.07 0.06
query5 0.53 0.53 0.51
query6 1.24 0.64 0.62
query7 0.01 0.01 0.01
query8 0.04 0.02 0.02
query9 0.52 0.48 0.47
query10 0.54 0.54 0.53
query11 0.12 0.09 0.09
query12 0.11 0.09 0.09
query13 0.62 0.61 0.61
query14 0.78 0.78 0.79
query15 0.78 0.75 0.77
query16 0.38 0.37 0.36
query17 1.00 1.00 0.99
query18 0.24 0.23 0.25
query19 1.96 1.88 1.82
query20 0.02 0.02 0.01
query21 15.48 0.55 0.54
query22 2.16 2.21 1.36
query23 17.61 0.96 0.96
query24 5.09 1.49 1.68
query25 0.42 0.12 0.04
query26 0.66 0.13 0.14
query27 0.04 0.03 0.03
query28 7.03 0.72 0.71
query29 12.63 2.32 2.26
query30 0.61 0.52 0.52
query31 2.83 0.40 0.36
query32 3.42 0.50 0.50
query33 3.03 3.12 3.07
query34 15.28 4.80 4.77
query35 4.86 4.84 4.81
query36 1.05 1.02 1.02
query37 0.05 0.04 0.04
query38 0.04 0.02 0.02
query39 0.01 0.02 0.02
query40 0.16 0.13 0.13
query41 0.06 0.02 0.01
query42 0.02 0.02 0.01
query43 0.02 0.02 0.01
Total cold run time: 103.62 s
Total hot run time: 30.84 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org