You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "englefly (via GitHub)" <gi...@apache.org> on 2024/07/23 13:16:30 UTC
[PR] [feat](FE) add rest api to get last profile [doris]
englefly opened a new pull request, #38268:
URL: https://github.com/apache/doris/pull/38268
## Proposed changes
if you want to get the profile of the query just executed, it not neccessary to find the query_id now.
this is useful to get profiles in shell script, for example, we want to get all profiles of tpcds queries (103 query profile) in a shell script.
before:
curl http://root:@127.0.0.1:8030/api/profile/text?query_id=990cc3b19e464e03-a3af05a997eb4091 > profile
after:
curl http://root:@127.0.0.1:8030/api/profile/text > profilex
Issue Number: close #xxx
<!--Describe your changes.-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245229519
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly merged PR #38268:
URL: https://github.com/apache/doris/pull/38268
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245229370
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2247764417
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245327539
<details>
<summary>ClickBench: <b>Total hot run time: 30.32 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ce4aa91a3607dfe56737b068826e4902dad4b61c, data reload: false
query1 0.04 0.03 0.03
query2 0.08 0.04 0.04
query3 0.22 0.05 0.05
query4 1.68 0.08 0.08
query5 0.49 0.48 0.48
query6 1.13 0.73 0.72
query7 0.01 0.01 0.01
query8 0.05 0.04 0.04
query9 0.55 0.49 0.49
query10 0.54 0.56 0.54
query11 0.15 0.11 0.11
query12 0.15 0.12 0.12
query13 0.60 0.60 0.59
query14 0.75 0.78 0.79
query15 0.86 0.83 0.81
query16 0.36 0.36 0.37
query17 0.95 1.03 0.98
query18 0.22 0.22 0.22
query19 1.76 1.68 1.80
query20 0.01 0.00 0.01
query21 15.39 0.75 0.64
query22 4.46 7.06 1.62
query23 18.27 1.43 1.28
query24 2.12 0.22 0.22
query25 0.16 0.08 0.09
query26 0.31 0.22 0.21
query27 0.45 0.24 0.23
query28 13.29 1.02 1.00
query29 12.61 3.31 3.30
query30 0.26 0.06 0.06
query31 2.85 0.39 0.39
query32 3.28 0.48 0.47
query33 2.88 2.94 2.92
query34 17.22 4.35 4.34
query35 4.43 4.40 4.41
query36 0.65 0.46 0.49
query37 0.19 0.17 0.16
query38 0.15 0.14 0.15
query39 0.04 0.04 0.03
query40 0.16 0.13 0.13
query41 0.10 0.04 0.05
query42 0.06 0.04 0.05
query43 0.05 0.04 0.03
Total cold run time: 109.98 s
Total hot run time: 30.32 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2247764485
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245285021
<details>
<summary>TPC-H: <b>Total hot run time: 40118 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ce4aa91a3607dfe56737b068826e4902dad4b61c, data reload: false
------ Round 1 ----------------------------------
q1 17962 4535 4326 4326
q2 2019 188 183 183
q3 10799 1260 1135 1135
q4 10559 763 765 763
q5 7920 2733 2730 2730
q6 223 137 138 137
q7 986 611 601 601
q8 9575 2103 2091 2091
q9 8990 6663 6690 6663
q10 9465 3740 3774 3740
q11 455 238 236 236
q12 393 223 221 221
q13 17799 3000 2957 2957
q14 273 235 230 230
q15 539 489 486 486
q16 492 381 379 379
q17 960 677 713 677
q18 8062 7420 7540 7420
q19 2094 1377 1317 1317
q20 675 309 322 309
q21 5020 3228 3282 3228
q22 351 291 289 289
Total cold run time: 115611 ms
Total hot run time: 40118 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4429 4281 4259 4259
q2 359 268 270 268
q3 3000 2765 2914 2765
q4 2004 1659 1687 1659
q5 5587 5499 5520 5499
q6 223 129 130 129
q7 2201 1881 1846 1846
q8 3324 3460 3430 3430
q9 8770 8495 8698 8495
q10 4092 3854 3795 3795
q11 586 494 493 493
q12 806 634 629 629
q13 17848 3139 3217 3139
q14 314 282 305 282
q15 535 482 502 482
q16 513 435 429 429
q17 1807 1534 1536 1534
q18 8071 8110 7750 7750
q19 1746 1486 1587 1486
q20 2097 1807 1788 1788
q21 8302 4868 4810 4810
q22 628 535 505 505
Total cold run time: 77242 ms
Total hot run time: 55472 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2245314964
<details>
<summary>TPC-DS: <b>Total hot run time: 173778 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ce4aa91a3607dfe56737b068826e4902dad4b61c, data reload: false
query1 909 384 361 361
query2 6299 1857 1777 1777
query3 6656 205 218 205
query4 28183 17556 16992 16992
query5 3716 474 480 474
query6 277 170 158 158
query7 4575 292 279 279
query8 247 201 200 200
query9 8533 2447 2424 2424
query10 432 291 272 272
query11 10620 10081 10129 10081
query12 137 84 83 83
query13 1649 380 371 371
query14 10160 7628 7609 7609
query15 220 170 165 165
query16 7491 467 474 467
query17 1156 586 546 546
query18 1962 287 285 285
query19 198 154 151 151
query20 93 85 82 82
query21 214 131 126 126
query22 4290 4236 4025 4025
query23 34065 33554 33689 33554
query24 12358 2966 2962 2962
query25 706 411 429 411
query26 1831 160 155 155
query27 2952 279 289 279
query28 7781 2091 2092 2091
query29 1249 667 667 667
query30 290 151 156 151
query31 971 775 785 775
query32 99 53 57 53
query33 789 357 356 356
query34 931 509 505 505
query35 865 762 766 762
query36 1135 972 979 972
query37 283 78 84 78
query38 3001 2859 2899 2859
query39 890 822 811 811
query40 251 124 118 118
query41 44 43 43 43
query42 118 98 102 98
query43 489 459 447 447
query44 1186 726 729 726
query45 201 156 161 156
query46 1098 727 742 727
query47 1847 1785 1774 1774
query48 375 294 286 286
query49 1012 398 406 398
query50 785 383 380 380
query51 6780 6734 6618 6618
query52 102 89 94 89
query53 356 288 287 287
query54 862 450 457 450
query55 74 72 73 72
query56 292 278 267 267
query57 1160 1016 1067 1016
query58 244 257 261 257
query59 2764 2742 2536 2536
query60 310 272 269 269
query61 107 93 110 93
query62 802 649 652 649
query63 311 283 282 282
query64 10300 2224 1691 1691
query65 3171 3152 3084 3084
query66 1281 326 327 326
query67 15788 14963 14958 14958
query68 8515 554 544 544
query69 700 408 362 362
query70 1402 1138 1158 1138
query71 547 278 274 274
query72 9012 5807 5974 5807
query73 2186 365 324 324
query74 6250 5665 5630 5630
query75 5413 2691 2662 2662
query76 5254 926 904 904
query77 765 309 301 301
query78 11098 9117 8892 8892
query79 11824 538 529 529
query80 856 470 464 464
query81 583 225 227 225
query82 294 127 131 127
query83 336 163 161 161
query84 275 85 83 83
query85 894 308 343 308
query86 351 327 308 308
query87 3372 3154 3103 3103
query88 4932 2403 2398 2398
query89 532 385 389 385
query90 2202 193 190 190
query91 128 102 97 97
query92 61 48 53 48
query93 6141 509 504 504
query94 1418 297 276 276
query95 419 317 318 317
query96 604 277 286 277
query97 3151 3010 3038 3010
query98 216 198 204 198
query99 1544 1261 1287 1261
Total cold run time: 311598 ms
Total hot run time: 173778 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2246659349
run external
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feat](FE) add rest api to get last profile [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #38268:
URL: https://github.com/apache/doris/pull/38268#issuecomment-2246659209
run cloud_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org