You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "hello-stephen (via GitHub)" <gi...@apache.org> on 2023/12/14 14:33:49 UTC
[PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
hello-stephen opened a new pull request, #28431:
URL: https://github.com/apache/doris/pull/28431
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871267106
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit 644e7650930893c887be428d38ce4093c67ad482, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5352 5234 5158 5158
q2 390 162 149 149
q3 1462 1133 1195 1133
q4 1089 871 824 824
q5 3116 3095 3047 3047
q6 233 138 138 138
q7 965 534 539 534
q8 2146 2171 2189 2171
q9 6879 6828 6820 6820
q10 3171 3145 3140 3140
q11 344 219 227 219
q12 384 242 237 237
q13 4397 3692 3643 3643
q14 266 215 218 215
q15 625 565 569 565
q16 461 404 411 404
q17 1046 598 502 502
q18 7095 6706 6802 6706
q19 1643 1516 1550 1516
q20 587 552 368 368
q21 2901 2550 2499 2499
q22 399 325 318 318
Total cold run time: 44951 ms
Total hot run time: 40306 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 5146 5076 5084 5076
q2 334 249 260 249
q3 3386 3345 3295 3295
q4 2144 2055 2019 2019
q5 5945 5967 5946 5946
q6 234 135 130 130
q7 2383 1938 1919 1919
q8 3555 3647 3662 3647
q9 9036 9005 8969 8969
q10 3888 3907 3970 3907
q11 593 489 480 480
q12 811 647 692 647
q13 3858 3200 3179 3179
q14 306 263 293 263
q15 625 589 556 556
q16 557 509 523 509
q17 2028 1859 1815 1815
q18 8765 8411 8415 8411
q19 1752 1709 1735 1709
q20 2301 2011 2010 2010
q21 5717 5320 5320 5320
q22 567 541 489 489
Total cold run time: 63931 ms
Total hot run time: 60545 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #28431:
URL: https://github.com/apache/doris/pull/28431
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1866256060
<details>
<summary>TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
TPC-DS sf1 test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: true
run tpcds-sf1 query with default conf and session variables
query78 166 162 154 154
query79 58 56 52 52
query80 128 126 132 126
query81 39 40 39 39
query82 26 25 24 24
query83 72 63 65 63
query84 41 40 38 38
query85 187 189 184 184
query86 36 38 36 36
query87 80 72 73 72
query88 135 132 133 132
query89 47 42 42 42
query90 35 33 32 32
query91 59 65 63 63
query92 26 27 22 22
query93 17 18 17 17
query94 58 56 57 56
query95 70 64 64 64
query96 28 28 29 28
query97 78 74 74 74
query98 39 38 38 38
query99 47 46 44 44
Total cold run time: 10109 ms
Total hot run time: 8904 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1857442084
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7219448671") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' returned error 1 finding the following syntactical issues:
----------
In regression-test/pipeline/performance/clean.sh line 36:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 81:
bash "${teamcity_build_checkoutDir}"/tools/clickbench-tools/bin/create-clickbench-tables.sh -s "${SF}"
^---^ SC2154 (warning): SF is referenced but not assigned.
For more information:
https://www.shellcheck.net/wiki/SC2154 -- SF is referenced but not assigned.
https://www.shellcheck.net/wiki/SC1091 -- Not following: ../../common/doris...
----------
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -69,14 +69,14 @@
if ! restart_doris; then echo "ERROR: Restart doris failed" && exit 1; fi
echo "#### 2. check if need to load data"
- CLICKBENCH_DATA_DIR="/data/clickbench" # no / at the end
+ CLICKBENCH_DATA_DIR="/data/clickbench" # no / at the end
CLICKBENCH_DATA_DIR_LINK="${teamcity_build_checkoutDir}"/tools/clickbench-tools/data # no / at the end
db_name="clickbench"
if ! check_clickbench_table_rows "${db_name}"; then
echo "INFO: need to load clickbench data"
# prepare data
mkdir -p "${CLICKBENCH_DATA_DIR}"
-
+
# create table and load data
bash "${teamcity_build_checkoutDir}"/tools/clickbench-tools/bin/create-clickbench-tables.sh -s "${SF}"
rm -rf "${CLICKBENCH_DATA_DIR_LINK}"
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870915085
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit 31b942148444f0baa50ae5bce5d1b47ea41fd2d2, data reload: false
run tpch-sf100 query with default conf and session variables
q1 17716 4692 4624 4624
q2 2037 138 131 131
q3 10614 1074 1183 1074
q4 10217 782 934 782
q5 7779 2942 3054 2942
q6 238 126 125 125
q7 999 494 520 494
q8 9262 1923 2006 1923
q9 6687 6631 6607 6607
q10 8308 3206 3173 3173
q11 419 205 218 205
q12 363 211 212 211
q13 18024 3486 3491 3486
q14 250 220 215 215
q15 560 517 512 512
q16 453 400 399 399
q17 950 718 560 560
q18 7323 6655 6629 6629
q19 1607 1527 1525 1525
q20 588 323 322 322
q21 3006 2613 2642 2613
q22 350 300 304 300
Total cold run time: 107750 ms
Total hot run time: 38852 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4663 4638 4629 4629
q2 279 167 169 167
q3 3318 3319 3299 3299
q4 2186 2188 2191 2188
q5 5600 5624 5601 5601
q6 231 116 118 116
q7 2363 1827 1832 1827
q8 3419 3429 3428 3428
q9 9148 9101 9096 9096
q10 3744 3835 3819 3819
q11 485 365 370 365
q12 761 606 594 594
q13 7993 3161 3218 3161
q14 288 248 250 248
q15 570 527 517 517
q16 486 442 436 436
q17 1889 1868 1861 1861
q18 8470 8159 8124 8124
q19 1649 1657 1652 1652
q20 2131 1902 1899 1899
q21 5983 5654 5654 5654
q22 521 456 472 456
Total cold run time: 66177 ms
Total hot run time: 59137 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871123491
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit ca936673fe4cb73f19efcdfa1b31ef89ce0c536e, data reload: false
------ Round 1 ----------------------------------
q1 22171 4732 4638 4638
q2 3940 237 177 177
q3 14515 1222 1309 1222
q4 15135 856 963 856
q5 14816 3258 3270 3258
q6 266 139 168 139
q7 1087 547 520 520
q8 12946 2050 2149 2050
q9 9456 7220 7371 7220
q10 11136 3483 3614 3483
q11 478 246 220 220
q12 448 231 237 231
q13 28160 3657 3618 3618
q14 590 225 229 225
q15 613 559 570 559
q16 1182 428 428 428
q17 1574 830 559 559
q18 14680 7221 7843 7221
q19 1859 1599 1600 1599
q20 652 356 357 356
q21 3324 2767 2738 2738
q22 380 333 347 333
Total cold run time: 159408 ms
Total hot run time: 41650 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5013 4839 4731 4731
q2 343 209 180 180
q3 3395 3335 3309 3309
q4 2193 2188 2175 2175
q5 5608 5588 5593 5588
q6 234 115 116 115
q7 2305 1839 1847 1839
q8 3398 3409 3406 3406
q9 9122 9050 9092 9050
q10 3757 3868 3853 3853
q11 484 360 362 360
q12 768 596 585 585
q13 9421 3167 3181 3167
q14 285 241 260 241
q15 573 518 516 516
q16 495 454 433 433
q17 1884 1862 1841 1841
q18 8620 8025 8020 8020
q19 1644 1648 1637 1637
q20 2164 1909 1900 1900
q21 5889 5583 5589 5583
q22 539 456 446 446
Total cold run time: 68134 ms
Total hot run time: 58975 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870846519
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7344861038") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -42,7 +42,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1857987290
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7223412690") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' returned error 1 finding the following syntactical issues:
----------
In regression-test/pipeline/performance/clean.sh line 36:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
For more information:
https://www.shellcheck.net/wiki/SC1091 -- Not following: ../../common/doris...
----------
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' found no issues.
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1865440015
<details>
<summary>TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
TPC-DS sf1 test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: true
run tpcds-sf1 query with default conf and session variables
query78 164 159 178 159
query79 50 49 48 48
query80 135 125 123 123
query81 40 50 37 37
query82 24 24 33 24
query83 72 64 67 64
query84 37 37 36 36
query85 192 198 182 182
query86 34 37 38 37
query87 78 76 68 68
query88 116 121 120 120
query89 40 40 40 40
query90 34 32 35 32
query91 63 58 59 58
query92 24 22 22 22
query93 19 18 17 17
query94 59 55 55 55
query95 76 69 63 63
query96 28 27 26 26
query97 75 80 74 74
query98 36 35 35 35
query99 51 51 46 46
Total cold run time: 9827 ms
Total hot run time: 8683 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1869993246
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7335774606") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
--- regression-test/pipeline/performance/run-tpch.sh.orig
+++ regression-test/pipeline/performance/run-tpch.sh
@@ -58,7 +58,7 @@
DORIS_HOME="${teamcity_build_checkoutDir}/output"
export DORIS_HOME
cold_run_time_threshold=${cold_run_time_threshold:-200000} # ms
-hot_run_time_threshold=${hot_run_time_threshold:-42000} # ms
+hot_run_time_threshold=${hot_run_time_threshold:-42000} # ms
exit_flag=0
(
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871092646
ClickBench test result on commit a00a48d163ea941da42193b1c51d324f8ddfe0cc, data reload: false
query1 0.03 0.01 0.01
query2 0.06 0.03 0.02
query3 0.25 0.05 0.04
query4 1.88 0.06 0.06
query5 0.51 0.50 0.49
query6 1.44 0.66 0.69
query7 0.02 0.01 0.00
query8 0.03 0.03 0.03
query9 0.56 0.49 0.48
query10 0.55 0.56 0.56
query11 0.15 0.09 0.10
query12 0.13 0.10 0.10
query13 0.60 0.59 0.60
query14 0.78 0.77 0.80
query15 0.85 0.80 0.79
query16 0.36 0.33 0.35
query17 0.97 0.89 0.92
query18 0.28 0.27 0.27
query19 1.73 1.69 1.72
query20 0.02 0.01 0.01
query21 15.34 0.59 0.53
query22 1.56 2.62 1.74
query23 17.20 0.98 0.82
query24 7.32 0.54 1.28
query25 1.47 0.14 0.15
query26 0.30 0.16 0.15
query27 0.16 0.14 0.15
query28 7.45 0.76 0.75
query29 12.79 3.23 3.21
query30 0.53 0.55 0.53
query31 2.79 0.36 0.37
query32 3.42 0.49 0.48
query33 3.22 3.18 3.20
query34 15.51 4.16 4.16
query35 4.14 4.16 4.13
query36 1.07 0.98 1.00
query37 0.07 0.05 0.05
query38 0.07 0.02 0.02
query39 0.03 0.02 0.02
query40 0.16 0.14 0.13
query41 0.08 0.02 0.01
query42 0.04 0.01 0.01
query43 0.04 0.02 0.02
Total cold run time: 105.96 s
Total hot run time: 29.98 s
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870879199
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7345254981") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -42,7 +42,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871210613
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871272177
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.34 seconds
stream load tsv: 564 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.2 seconds inserted 10000000 Rows, about 354K ops/s
storage size: 17183838999 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1868849186
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf1 test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: true
run tpch-sf1 query with default conf and session variables
q1 141 92 89 89
q2 188 61 60 60
q3 73 61 61 61
q4 65 47 49 47
q5 132 95 94 94
q6 41 39 37 37
q7 105 88 100 88
q8 134 106 101 101
q9 111 103 100 100
q10 66 69 75 69
q11 87 71 79 71
q12 74 60 49 49
q13 113 76 71 71
q14 36 35 34 34
q15 62 59 60 59
q16 62 66 56 56
q17 45 48 45 45
q18 79 72 84 72
q19 52 47 48 47
q20 69 62 58 58
q21 116 113 111 111
q22 47 45 46 45
Total cold run time: 1898 ms
Total hot run time: 1464 ms
run tpch-sf1 query with default conf and set session variable runtime_filter_mode=off
q1 86 86 77 77
q2 40 42 67 42
q3 55 52 52 52
q4 47 45 43 43
q5 74 84 77 77
q6 32 33 31 31
q7 81 71 73 71
q8 89 94 90 90
q9 93 93 92 92
q10 64 82 62 62
q11 57 55 57 55
q12 52 51 53 51
q13 63 66 62 62
q14 33 34 33 33
q15 56 50 53 50
q16 49 48 47 47
q17 40 38 41 38
q18 85 79 78 78
q19 46 49 50 49
q20 63 62 64 62
q21 108 103 107 103
q22 36 61 34 34
Total cold run time: 1349 ms
Total hot run time: 1299 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871233707
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1866145928
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7287944159") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/compile.sh.orig
+++ regression-test/pipeline/performance/compile.sh
@@ -30,7 +30,7 @@
EOF
if ${DEBUG:-false}; then
-
+
pull_request_num="28431"
commit_id="b052225cd0a180b4576319b5bd6331218dd0d3fe"
target_branch="master"
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1868708481
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7318886013") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870835171
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7344720688") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870881158
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870935873
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7345858602") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -42,7 +42,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1855963559
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7210332825") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' returned error 1 finding the following syntactical issues:
----------
In regression-test/pipeline/performance/clean.sh line 36:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 35:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 37:
source ../../common/github-utils.sh
^--------------------------^ SC1091 (info): Not following: ../../common/github-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 39:
source ../../common/oss-utils.sh
^-----------------------^ SC1091 (info): Not following: ../../common/oss-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 50:
DORIS_HOME="${teamcity_build_checkoutDir}/output"
^--------^ SC2034 (warning): DORIS_HOME appears unused. Verify use (or export if used externally).
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 35:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 37:
source ../../common/github-utils.sh
^--------------------------^ SC1091 (info): Not following: ../../common/github-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 39:
source ../../common/oss-utils.sh
^-----------------------^ SC1091 (info): Not following: ../../common/oss-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 50:
DORIS_HOME="${teamcity_build_checkoutDir}/output"
^--------^ SC2034 (warning): DORIS_HOME appears unused. Verify use (or export if used externally).
For more information:
https://www.shellcheck.net/wiki/SC2034 -- DORIS_HOME appears unused. Verify...
https://www.shellcheck.net/wiki/SC1091 -- Not following: ../../common/doris...
----------
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-tpcds-sf100.sh.orig
+++ regression-test/pipeline/performance/run-tpcds-sf100.sh
@@ -83,7 +83,7 @@
if ${DEBUG:-false}; then
SF="100"
fi
- TPCDS_DATA_DIR="/data/tpcds/sf_${SF}" # no / at the end
+ TPCDS_DATA_DIR="/data/tpcds/sf_${SF}" # no / at the end
TPCDS_DATA_DIR_LINK="${teamcity_build_checkoutDir}"/tools/tpcds-tools/bin/tpcds-data # no / at the end
db_name="tpcds_sf${SF}"
sed -i "s|^export DB=.*$|export DB='${db_name}'|g" \
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1862813094
<details>
<summary>ClickBench test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
ClickBench test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: false
run clickbench query with default conf and session variables
query1,0.01,0.01,0.01
query2,0.01,0.01,0.01
query3,0.01,0.01,0.01
query4,0.01,0.01,0.01
query5,0.02,0.01,0.01
query6,0.02,0.01,0.01
query7,0.01,0.00,0.01
query8,0.02,0.01,0.01
query9,0.02,0.01,0.01
query10,0.02,0.02,0.01
query11,0.01,0.01,0.01
query12,0.01,0.01,0.00
query13,0.01,0.00,0.01
query14,0.01,0.00,0.01
query15,0.01,0.01,0.00
query16,0.01,0.00,0.01
query17,0.01,0.00,0.01
query18,0.01,0.01,0.01
query19,0.01,0.01,0.01
query20,0.01,0.01,0.00
query21,0.01,0.01,0.01
query22,0.01,0.01,0.02
query23,0.02,0.01,0.00
query24,0.02,0.01,0.02
query25,0.01,0.01,0.01
query26,0.01,0.01,0.01
query27,0.01,0.01,0.00
query28,0.02,0.01,0.01
query29,0.01,0.00,0.01
query30,0.03,0.03,0.04
query31,0.01,0.01,0.01
query32,0.02,0.02,0.01
query33,0.01,0.01,0.01
query34,0.01,0.01,0.00
query35,0.00,0.01,0.01
query36,0.00,0.01,0.01
query37,0.01,0.01,0.01
query38,0.01,0.01,0.00
query39,0.02,0.01,0.01
query40,0.02,0.01,0.01
query41,0.02,0.01,0.01
query42,0.00,0.00,0.01
query43,0.01,0.01,0.01
Total cold run time: 0.54 s
Total hot run time: 0.31 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1865406244
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7283425192") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/compile.sh.orig
+++ regression-test/pipeline/performance/compile.sh
@@ -30,7 +30,7 @@
EOF
if ${DEBUG:-false}; then
-
+
pull_request_num="28431"
commit_id="b052225cd0a180b4576319b5bd6331218dd0d3fe"
target_branch="master"
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871218044
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870966332
TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
```
TPC-DS sf100 test result on commit a00a48d163ea941da42193b1c51d324f8ddfe0cc, data reload: false
run tpcds-sf100 query with default conf and session variables
query78 9489 8536 8744 8536
query79 2472 513 512 512
query80 1008 345 342 342
query81 536 211 201 201
query82 209 98 97 97
query83 396 132 139 132
query84 268 57 55 55
query85 1012 265 254 254
query86 506 396 407 396
query87 3546 3369 3393 3369
query88 3193 2292 2324 2292
query89 344 261 261 261
query90 1953 210 212 210
query91 171 127 127 127
query92 71 54 52 52
query93 1742 440 496 440
query94 824 200 196 196
query95 579 567 552 552
query96 658 330 320 320
query97 4315 4150 4162 4150
query98 208 191 184 184
query99 1129 797 858 797
Total cold run time: 290524 ms
Total hot run time: 179439 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1862872348
<details>
<summary>TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
TPC-DS sf1 test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: false
run tpcds-sf1 query with default conf and session variables
query78 188 198 177 177
query79 58 62 55 55
query80 167 175 171 171
query81 42 39 39 39
query82 24 24 25 24
query83 76 69 68 68
query84 37 37 36 36
query85 173 170 170 170
query86 38 37 38 37
query87 83 80 78 78
query88 181 193 180 180
query89 45 43 46 43
query90 41 39 40 39
query91 61 59 59 59
query92 26 27 26 26
query93 17 17 17 17
query94 70 71 69 69
query95 75 68 67 67
query96 35 32 31 31
query97 92 96 96 96
query98 40 39 41 39
query99 48 54 49 49
Total cold run time: 11081 ms
Total hot run time: 9824 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1865438691
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf1 test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: true
run tpch-sf1 query with default conf and session variables
q1 125 88 84 84
q2 163 58 59 58
q3 53 42 41 41
q4 55 40 37 37
q5 115 85 82 82
q6 31 26 24 24
q7 84 71 68 68
q8 126 115 98 98
q9 101 92 95 92
q10 59 60 67 60
q11 92 61 60 60
q12 39 30 35 30
q13 71 58 55 55
q14 27 26 27 26
q15 42 38 39 38
q16 70 56 53 53
q17 34 33 31 31
q18 71 70 80 70
q19 39 34 35 34
q20 49 44 45 44
q21 91 85 99 85
q22 39 42 41 41
Total cold run time: 1576 ms
Total hot run time: 1211 ms
run tpch-sf1 query with default conf and set session variable runtime_filter_mode=off
q1 77 80 76 76
q2 42 40 41 40
q3 47 51 45 45
q4 41 39 37 37
q5 73 74 72 72
q6 20 20 19 19
q7 64 62 63 62
q8 83 111 91 91
q9 113 95 92 92
q10 56 53 55 53
q11 54 56 56 56
q12 31 30 33 30
q13 48 50 47 47
q14 24 24 23 23
q15 34 33 35 33
q16 48 47 49 47
q17 38 36 41 36
q18 85 77 77 77
q19 32 32 32 32
q20 54 56 51 51
q21 97 92 121 92
q22 39 34 35 34
Total cold run time: 1200 ms
Total hot run time: 1145 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870957479
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit a00a48d163ea941da42193b1c51d324f8ddfe0cc, data reload: false
run tpch-sf100 query with default conf and session variables
q1 17632 4671 4657 4657
q2 2029 148 135 135
q3 10783 1062 1186 1062
q4 10548 747 911 747
q5 7777 2974 3069 2974
q6 239 123 125 123
q7 1013 491 522 491
q8 9221 2004 2014 2004
q9 6699 6603 6586 6586
q10 8306 3243 3161 3161
q11 421 218 214 214
q12 360 205 205 205
q13 17996 3404 3407 3404
q14 244 214 203 203
q15 560 520 508 508
q16 442 389 385 385
q17 944 696 516 516
q18 7350 6807 6705 6705
q19 1595 1535 1539 1535
q20 614 320 319 319
q21 3058 2613 2632 2613
q22 347 305 313 305
Total cold run time: 108178 ms
Total hot run time: 38852 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4627 4614 4621 4614
q2 275 165 171 165
q3 3318 3329 3309 3309
q4 2191 2185 2187 2185
q5 5624 5622 5623 5622
q6 234 114 116 114
q7 2315 1833 1840 1833
q8 3427 3433 3439 3433
q9 9174 9145 9100 9100
q10 3772 3819 3833 3819
q11 469 385 382 382
q12 765 597 584 584
q13 7411 3213 3225 3213
q14 277 256 266 256
q15 567 519 514 514
q16 497 453 436 436
q17 1876 1886 1872 1872
q18 8685 8210 8186 8186
q19 1644 1650 1657 1650
q20 2187 1887 1913 1887
q21 5968 5643 5625 5625
q22 549 470 473 470
Total cold run time: 65852 ms
Total hot run time: 59269 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871152877
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.04 seconds
stream load tsv: 558 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.6 seconds inserted 10000000 Rows, about 349K ops/s
storage size: 17183773933 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870781882
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7344009219") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871183525
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit ca936673fe4cb73f19efcdfa1b31ef89ce0c536e, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4981 4630 4654 4630
q2 359 175 155 155
q3 1475 1241 1187 1187
q4 1125 950 880 880
q5 3315 3182 3165 3165
q6 273 126 124 124
q7 1039 486 504 486
q8 2297 2262 2265 2262
q9 6729 6668 6712 6668
q10 3181 3284 3280 3280
q11 331 201 203 201
q12 345 205 205 205
q13 4163 3399 3438 3399
q14 239 209 211 209
q15 570 518 516 516
q16 437 383 378 378
q17 1046 704 531 531
q18 7122 6821 6883 6821
q19 1635 1640 1651 1640
q20 516 319 295 295
q21 3170 2760 2682 2682
q22 362 296 305 296
Total cold run time: 44710 ms
Total hot run time: 40010 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4596 4585 4599 4585
q2 275 166 181 166
q3 3392 3379 3353 3353
q4 2207 2205 2210 2205
q5 5798 5718 5701 5701
q6 237 117 119 117
q7 2376 1854 1846 1846
q8 3609 3617 3625 3617
q9 8982 8932 8946 8932
q10 3775 3887 3906 3887
q11 493 376 370 370
q12 770 593 611 593
q13 3922 3192 3147 3147
q14 289 259 256 256
q15 579 520 518 518
q16 498 463 459 459
q17 1971 1968 1965 1965
q18 8619 8173 8275 8173
q19 1736 1776 1767 1767
q20 2243 1929 1917 1917
q21 6082 5731 5739 5731
q22 558 476 469 469
Total cold run time: 63007 ms
Total hot run time: 59774 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1869903976
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7334624918") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870878178
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7345245565") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -42,7 +42,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871191233
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1858036521
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7223763650") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' returned error 1 finding the following syntactical issues:
----------
In regression-test/pipeline/performance/clean.sh line 36:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
For more information:
https://www.shellcheck.net/wiki/SC1091 -- Not following: ../../common/doris...
----------
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' found no issues.
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1865429414
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7283693103") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/compile.sh.orig
+++ regression-test/pipeline/performance/compile.sh
@@ -30,7 +30,7 @@
EOF
if ${DEBUG:-false}; then
-
+
pull_request_num="28431"
commit_id="b052225cd0a180b4576319b5bd6331218dd0d3fe"
target_branch="master"
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1864013795
<details>
<summary>ClickBench test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
ClickBench test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: false
run clickbench query with tuned conf and tuned session variables
query1,0.03,0.02,0.02
query2,0.05,0.03,0.02
query3,0.23,0.04,0.04
query4,1.91,0.04,0.04
query5,0.59,0.61,0.60
query6,1.32,0.70,0.71
query7,0.02,0.01,0.01
query8,0.03,0.03,0.03
query9,0.61,0.58,0.57
query10,0.66,0.65,0.63
query11,0.15,0.09,0.10
query12,0.15,0.10,0.11
query13,0.67,0.67,0.66
query14,0.98,0.99,0.98
query15,0.98,0.95,0.94
query16,0.46,0.48,0.48
query17,1.23,1.22,1.23
query18,0.28,0.27,0.31
query19,2.33,2.28,2.18
query20,0.02,0.02,0.01
query21,15.13,1.31,1.43
query22,15.04,2.04,1.16
query23,17.05,1.41,1.28
query24,5.26,1.46,2.15
query25,2.30,0.12,0.13
query26,0.68,0.15,0.16
query27,0.14,0.12,0.12
query28,14.75,1.61,1.50
query29,12.75,3.62,3.60
query30,0.82,0.80,0.78
query31,2.96,0.49,0.48
query32,3.37,0.63,0.61
query33,3.53,3.50,3.54
query34,15.64,5.84,14.92
query35,15.86,5.72,8.90
query36,1.38,1.30,1.31
query37,0.15,0.06,0.06
query38,0.08,0.03,0.03
query39,0.04,0.02,0.02
query40,0.21,0.18,0.17
query41,0.08,0.02,0.02
query42,0.04,0.02,0.02
query43,0.03,0.02,0.03
Total cold run time: 139.99 s
Total hot run time: 38.86 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1866251882
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf1 test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: true
run tpch-sf1 query with default conf and session variables
q1 138 86 86 86
q2 184 61 60 60
q3 71 63 58 58
q4 64 50 51 50
q5 123 88 93 88
q6 45 37 40 37
q7 114 86 86 86
q8 139 105 102 102
q9 103 104 93 93
q10 66 68 74 68
q11 89 65 65 65
q12 64 53 51 51
q13 111 66 65 65
q14 34 33 35 33
q15 59 58 58 58
q16 66 64 55 55
q17 50 46 39 39
q18 87 74 84 74
q19 49 42 41 41
q20 66 59 56 56
q21 111 106 113 106
q22 46 44 45 44
Total cold run time: 1879 ms
Total hot run time: 1415 ms
run tpch-sf1 query with default conf and set session variable runtime_filter_mode=off
q1 95 79 77 77
q2 40 42 42 42
q3 61 60 54 54
q4 47 47 46 46
q5 102 76 72 72
q6 32 32 34 32
q7 76 69 72 69
q8 89 96 87 87
q9 91 98 92 92
q10 63 63 60 60
q11 56 54 57 54
q12 57 53 50 50
q13 64 58 57 57
q14 33 31 31 31
q15 52 53 51 51
q16 48 49 47 47
q17 39 37 38 37
q18 87 77 82 77
q19 50 48 48 48
q20 61 63 58 58
q21 104 100 104 100
q22 35 34 35 34
Total cold run time: 1382 ms
Total hot run time: 1275 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1855997596
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7210559293") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' returned error 1 finding the following syntactical issues:
----------
In regression-test/pipeline/performance/clean.sh line 36:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 35:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 37:
source ../../common/github-utils.sh
^--------------------------^ SC1091 (info): Not following: ../../common/github-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 39:
source ../../common/oss-utils.sh
^-----------------------^ SC1091 (info): Not following: ../../common/oss-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 50:
DORIS_HOME="${teamcity_build_checkoutDir}/output"
^--------^ SC2034 (warning): DORIS_HOME appears unused. Verify use (or export if used externally).
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 35:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 37:
source ../../common/github-utils.sh
^--------------------------^ SC1091 (info): Not following: ../../common/github-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 39:
source ../../common/oss-utils.sh
^-----------------------^ SC1091 (info): Not following: ../../common/oss-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 50:
DORIS_HOME="${teamcity_build_checkoutDir}/output"
^--------^ SC2034 (warning): DORIS_HOME appears unused. Verify use (or export if used externally).
For more information:
https://www.shellcheck.net/wiki/SC2034 -- DORIS_HOME appears unused. Verify...
https://www.shellcheck.net/wiki/SC1091 -- Not following: ../../common/doris...
----------
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-tpcds-sf100.sh.orig
+++ regression-test/pipeline/performance/run-tpcds-sf100.sh
@@ -83,7 +83,7 @@
if ${DEBUG:-false}; then
SF="100"
fi
- TPCDS_DATA_DIR="/data/tpcds/sf_${SF}" # no / at the end
+ TPCDS_DATA_DIR="/data/tpcds/sf_${SF}" # no / at the end
TPCDS_DATA_DIR_LINK="${teamcity_build_checkoutDir}"/tools/tpcds-tools/bin/tpcds-data # no / at the end
db_name="tpcds_sf${SF}"
sed -i "s|^export DB=.*$|export DB='${db_name}'|g" \
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1863969979
<details>
<summary>ClickBench test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
ClickBench test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: false
run clickbench query with default conf and session variables
query1,0.03,0.01,0.01
query2,0.07,0.04,0.03
query3,0.23,0.03,0.03
query4,1.92,0.04,0.04
query5,0.62,0.59,0.64
query6,1.37,0.70,0.72
query7,0.02,0.00,0.00
query8,0.03,0.04,0.02
query9,0.63,0.57,0.56
query10,0.63,0.64,0.64
query11,0.15,0.09,0.09
query12,0.15,0.10,0.10
query13,0.69,0.67,0.67
query14,0.98,0.99,1.04
query15,0.95,0.95,0.96
query16,0.44,0.47,0.47
query17,1.24,1.26,1.25
query18,0.28,0.32,0.28
query19,2.31,2.27,2.24
query20,0.02,0.02,0.02
query21,15.14,1.38,1.44
query22,13.92,3.06,1.20
query23,17.28,1.42,1.31
query24,5.86,0.95,1.10
query25,2.28,0.13,0.14
query26,0.68,0.14,0.15
query27,0.14,0.14,0.11
query28,13.68,2.24,1.56
query29,12.74,3.56,3.57
query30,0.80,0.76,0.80
query31,2.88,0.47,0.47
query32,3.35,0.62,0.62
query33,3.59,3.58,3.59
query34,15.76,6.00,9.30
query35,15.70,5.90,15.84
query36,1.36,1.28,1.27
query37,0.15,0.06,0.06
query38,0.07,0.03,0.03
query39,0.04,0.02,0.02
query40,0.23,0.18,0.17
query41,0.09,0.02,0.02
query42,0.03,0.02,0.02
query43,0.04,0.02,0.02
Total cold run time: 138.57 s
Total hot run time: 38.96 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871113767
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871177684
TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
```
TPC-DS sf100 test result on commit ca936673fe4cb73f19efcdfa1b31ef89ce0c536e, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 923 353 339 339
query2 2741 2224 2153 2153
query3 6694 220 222 220
query4 27234 22304 22126 22126
query5 3193 581 516 516
query6 269 175 169 169
query7 4603 283 280 280
query8 219 203 199 199
query9 8209 2744 2743 2743
query10 427 238 238 238
query11 16061 15381 15319 15319
query12 131 81 74 74
query13 1627 355 338 338
query14 11209 7187 7213 7187
query15 250 181 194 181
query16 5531 283 279 279
query17 1816 472 473 472
query18 1940 271 258 258
query19 241 132 133 132
query20 79 72 89 72
query21 179 89 92 89
query22 4982 4809 4868 4809
query23 32258 31150 31166 31150
query24 12207 2854 2822 2822
query25 562 338 325 325
query26 1357 135 143 135
query27 2853 286 283 283
query28 6945 2042 2047 2042
query29 1186 389 376 376
query30 289 140 139 139
query31 983 756 786 756
query32 72 58 53 53
query33 701 276 258 258
query34 914 461 464 461
query35 848 758 684 684
query36 1258 1242 1168 1168
query37 182 67 68 67
query38 3408 3289 3343 3289
query39 1337 1299 1301 1299
query40 314 88 87 87
query41 37 35 36 35
query42 102 88 88 88
query43 538 537 504 504
query44 1129 755 770 755
query45 199 185 183 183
query46 1077 676 657 657
query47 1740 1508 1521 1508
query48 390 311 321 311
query49 1248 310 299 299
query50 745 336 347 336
query51 5383 5293 5205 5205
query52 99 81 85 81
query53 220 153 148 148
query54 1397 589 586 586
query55 102 84 84 84
query56 214 187 192 187
query57 1019 955 930 930
query58 209 189 194 189
query59 2832 2622 2611 2611
query60 239 217 228 217
query61 74 72 73 72
query62 632 475 460 460
query63 165 144 143 143
query64 4875 1485 1535 1485
query65 3343 3257 3240 3240
query66 1423 337 317 317
query67 15341 15604 15217 15217
query68 11335 535 576 535
query69 613 264 268 264
query70 1624 1597 1487 1487
query71 569 217 216 216
query72 4292 3302 3313 3302
query73 1389 328 329 328
query74 7022 6429 6417 6417
query75 5692 2289 2288 2288
query76 5189 1136 1175 1136
query77 885 264 237 237
query78 9490 8589 8478 8478
query79 1965 515 522 515
query80 1719 344 339 339
query81 534 208 206 206
query82 228 95 91 91
query83 376 139 135 135
query84 270 56 54 54
query85 1853 265 266 265
query86 422 385 405 385
query87 3586 3343 3378 3343
query88 3189 2455 2428 2428
query89 333 265 261 261
query90 2070 225 224 224
query91 173 133 132 132
query92 67 51 51 51
query93 1313 500 444 444
query94 826 187 189 187
query95 591 539 570 539
query96 646 345 338 338
query97 4290 4159 4122 4122
query98 201 195 180 180
query99 1139 871 811 811
Total cold run time: 284895 ms
Total hot run time: 179173 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1869421095
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7328533923") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1868850495
<details>
<summary>TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
TPC-DS sf1 test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: true
run tpcds-sf1 query with default conf and session variables
query78 168 160 159 159
query79 56 56 74 56
query80 135 127 131 127
query81 41 41 40 40
query82 27 26 25 25
query83 78 65 72 65
query84 45 40 39 39
query85 193 198 185 185
query86 38 35 36 35
query87 84 74 73 73
query88 142 132 133 132
query89 48 42 46 42
query90 36 33 34 33
query91 78 60 63 60
query92 25 26 23 23
query93 18 17 17 17
query94 59 59 56 56
query95 71 67 66 66
query96 29 30 33 30
query97 81 77 73 73
query98 41 38 38 38
query99 47 46 47 46
Total cold run time: 10292 ms
Total hot run time: 9037 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1865422465
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7283614224") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/compile.sh.orig
+++ regression-test/pipeline/performance/compile.sh
@@ -30,7 +30,7 @@
EOF
if ${DEBUG:-false}; then
-
+
pull_request_num="28431"
commit_id="b052225cd0a180b4576319b5bd6331218dd0d3fe"
target_branch="master"
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -41,7 +41,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871093232
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
ClickBench test result on commit a00a48d163ea941da42193b1c51d324f8ddfe0cc, data reload: false
query1 0.03 0.01 0.01
query2 0.06 0.03 0.02
query3 0.25 0.05 0.04
query4 1.88 0.06 0.06
query5 0.51 0.50 0.49
query6 1.44 0.66 0.69
query7 0.02 0.01 0.00
query8 0.03 0.03 0.03
query9 0.56 0.49 0.48
query10 0.55 0.56 0.56
query11 0.15 0.09 0.10
query12 0.13 0.10 0.10
query13 0.60 0.59 0.60
query14 0.78 0.77 0.80
query15 0.85 0.80 0.79
query16 0.36 0.33 0.35
query17 0.97 0.89 0.92
query18 0.28 0.27 0.27
query19 1.73 1.69 1.72
query20 0.02 0.01 0.01
query21 15.34 0.59 0.53
query22 1.56 2.62 1.74
query23 17.20 0.98 0.82
query24 7.32 0.54 1.28
query25 1.47 0.14 0.15
query26 0.30 0.16 0.15
query27 0.16 0.14 0.15
query28 7.45 0.76 0.75
query29 12.79 3.23 3.21
query30 0.53 0.55 0.53
query31 2.79 0.36 0.37
query32 3.42 0.49 0.48
query33 3.22 3.18 3.20
query34 15.51 4.16 4.16
query35 4.14 4.16 4.13
query36 1.07 0.98 1.00
query37 0.07 0.05 0.05
query38 0.07 0.02 0.02
query39 0.03 0.02 0.02
query40 0.16 0.14 0.13
query41 0.08 0.02 0.01
query42 0.04 0.01 0.01
query43 0.04 0.02 0.02
Total cold run time: 105.96 s
Total hot run time: 29.98 s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871167487
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit ca936673fe4cb73f19efcdfa1b31ef89ce0c536e, data reload: false
------ Round 1 ----------------------------------
q1 17598 4740 4695 4695
q2 2035 152 148 148
q3 10587 1103 1154 1103
q4 10220 854 925 854
q5 7815 3062 3062 3062
q6 244 125 128 125
q7 1025 550 489 489
q8 9218 1996 1999 1996
q9 6684 6648 6635 6635
q10 8357 3217 3173 3173
q11 428 217 215 215
q12 366 214 212 212
q13 18017 3425 3409 3409
q14 243 217 206 206
q15 556 523 512 512
q16 493 389 383 383
q17 954 717 612 612
q18 7475 6751 6753 6751
q19 1598 1540 1530 1530
q20 602 352 322 322
q21 3026 2600 2601 2600
q22 346 301 309 301
Total cold run time: 107887 ms
Total hot run time: 39333 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4643 4677 4657 4657
q2 271 186 180 180
q3 3341 3317 3309 3309
q4 2220 2202 2188 2188
q5 5608 5629 5636 5629
q6 231 116 119 116
q7 2348 1836 1855 1836
q8 3439 3427 3449 3427
q9 9190 9139 9158 9139
q10 3742 3833 3820 3820
q11 490 366 367 366
q12 779 600 622 600
q13 8989 3230 3222 3222
q14 282 261 266 261
q15 569 522 511 511
q16 496 436 459 436
q17 1907 1881 1872 1872
q18 8553 8097 8104 8097
q19 1652 1651 1643 1643
q20 2179 1922 1888 1888
q21 5943 5642 5631 5631
q22 532 474 451 451
Total cold run time: 67404 ms
Total hot run time: 59279 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1870879886
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7345261954") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' found no issues.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-clickbench.sh.orig
+++ regression-test/pipeline/performance/run-clickbench.sh
@@ -42,7 +42,7 @@
# upload_doris_log_to_oss
source "${teamcity_build_checkoutDir}"/regression-test/pipeline/common/oss-utils.sh
-if ${DEBUG:-false}; then
+if ${DEBUG:-false}; then
pull_request_num="28431"
commit_id="5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5"
fi
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1871131865
TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
```
TPC-DS sf100 test result on commit ca936673fe4cb73f19efcdfa1b31ef89ce0c536e, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 930 351 335 335
query2 6515 1872 2063 1872
query3 6692 227 221 221
query4 26130 22284 22175 22175
query5 3960 515 523 515
query6 254 163 171 163
query7 4594 269 274 269
query8 220 207 216 207
query9 8284 2740 2714 2714
query10 460 269 250 250
query11 16091 15319 15424 15319
query12 130 72 73 72
query13 1605 350 359 350
query14 10951 7197 7195 7195
query15 221 184 196 184
query16 6255 273 289 273
query17 1453 488 478 478
query18 1805 263 259 259
query19 182 132 130 130
query20 82 77 78 77
query21 176 91 93 91
query22 5065 4775 4774 4774
query23 32032 31379 31038 31038
query24 11221 2833 2834 2833
query25 545 327 320 320
query26 866 141 139 139
query27 2708 283 283 283
query28 6055 2046 2046 2046
query29 830 392 382 382
query30 278 137 149 137
query31 975 767 772 767
query32 86 57 54 54
query33 686 266 261 261
query34 846 454 441 441
query35 866 726 764 726
query36 1365 1203 1223 1203
query37 102 66 69 66
query38 3412 3302 3237 3237
query39 1352 1296 1317 1296
query40 194 104 90 90
query41 37 39 39 39
query42 96 92 91 91
query43 530 503 499 499
query44 1099 769 781 769
query45 197 189 184 184
query46 1067 674 670 670
query47 1663 1656 1519 1519
query48 393 317 311 311
query49 1107 312 316 312
query50 739 383 392 383
query51 5356 5285 5297 5285
query52 102 81 85 81
query53 211 150 145 145
query54 1376 561 597 561
query55 104 84 88 84
query56 214 191 189 189
query57 983 970 956 956
query58 222 198 198 198
query59 2859 2764 2654 2654
query60 248 218 224 218
query61 80 78 73 73
query62 661 464 474 464
query63 166 144 146 144
query64 4214 1518 1582 1518
query65 3330 3255 3272 3255
query66 1151 329 334 329
query67 15565 15309 15277 15277
query68 12409 536 541 536
query69 589 265 278 265
query70 1576 1539 1468 1468
query71 563 218 224 218
query72 5212 3370 3318 3318
query73 1441 334 333 333
query74 6998 6455 6492 6455
query75 5580 2255 2287 2255
query76 5426 925 1167 925
query77 878 263 268 263
query78 9607 8493 8483 8483
query79 6075 520 512 512
query80 773 351 351 351
query81 535 209 207 207
query82 349 98 89 89
query83 155 136 143 136
query84 276 55 64 55
query85 1552 261 249 249
query86 459 399 431 399
query87 3575 3340 3380 3340
query88 3398 2443 2465 2443
query89 348 261 255 255
query90 1786 216 221 216
query91 185 122 130 122
query92 68 51 50 50
query93 2422 522 447 447
query94 668 193 195 193
query95 572 555 518 518
query96 661 340 339 339
query97 4232 4144 4198 4144
query98 208 193 186 186
query99 1142 818 818 818
Total cold run time: 289962 ms
Total hot run time: 179038 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1866230217
<details>
<summary>ClickBench test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
ClickBench test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: true
run clickbench query with tuned conf and tuned session variables
query1,0.01,0.00,0.00
query2,0.01,0.02,0.01
query3,0.02,0.01,0.01
query4,0.00,0.00,0.01
query5,0.03,0.01,0.01
query6,0.01,0.01,0.01
query7,0.01,0.00,0.00
query8,0.02,0.02,0.01
query9,0.01,0.01,0.01
query10,0.01,0.01,0.01
query11,0.01,0.01,0.03
query12,0.01,0.01,0.01
query13,0.00,0.00,0.00
query14,0.01,0.01,0.01
query15,0.02,0.01,0.02
query16,0.01,0.01,0.01
query17,0.00,0.01,0.01
query18,0.01,0.01,0.01
query19,0.01,0.01,0.01
query20,0.00,0.00,0.00
query21,0.01,0.00,0.01
query22,0.01,0.00,0.01
query23,0.01,0.02,0.02
query24,0.02,0.01,0.01
query25,0.01,0.01,0.01
query26,0.00,0.00,0.01
query27,0.01,0.01,0.01
query28,0.02,0.00,0.00
query29,0.02,0.01,0.01
query30,0.04,0.03,0.03
query31,0.01,0.01,0.00
query32,0.01,0.02,0.01
query33,0.01,0.01,0.01
query34,0.00,0.01,0.01
query35,0.01,0.01,0.01
query36,0.02,0.02,0.01
query37,0.02,0.02,0.02
query38,0.02,0.02,0.02
query39,0.01,0.01,0.01
query40,0.02,0.01,0.01
query41,0.04,0.00,0.01
query42,0.01,0.00,0.00
query43,0.01,0.01,0.01
Total cold run time: 0.55 s
Total hot run time: 0.36 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1868841630
<details>
<summary>ClickBench test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
ClickBench test result on commit 5f5c4c80564c76ff4267fc4ce6a5408498ed1ab5, data reload: true
run clickbench query with tuned conf and tuned session variables
query1,0.02,0.00,0.00
query2,0.01,0.01,0.01
query3,0.01,0.01,0.01
query4,0.01,0.00,0.00
query5,0.02,0.01,0.00
query6,0.02,0.01,0.01
query7,0.01,0.01,0.00
query8,0.02,0.01,0.01
query9,0.01,0.01,0.01
query10,0.01,0.01,0.01
query11,0.01,0.01,0.01
query12,0.02,0.02,0.01
query13,0.01,0.01,0.01
query14,0.02,0.01,0.01
query15,0.01,0.02,0.01
query16,0.01,0.01,0.00
query17,0.01,0.01,0.01
query18,0.01,0.01,0.00
query19,0.02,0.01,0.01
query20,0.00,0.00,0.00
query21,0.01,0.01,0.00
query22,0.02,0.01,0.01
query23,0.02,0.02,0.01
query24,0.02,0.01,0.01
query25,0.01,0.01,0.01
query26,0.01,0.01,0.01
query27,0.01,0.00,0.01
query28,0.02,0.02,0.02
query29,0.02,0.01,0.01
query30,0.05,0.03,0.03
query31,0.01,0.01,0.01
query32,0.02,0.01,0.01
query33,0.01,0.00,0.00
query34,0.01,0.01,0.00
query35,0.01,0.01,0.01
query36,0.00,0.00,0.01
query37,0.02,0.01,0.00
query38,0.01,0.01,0.01
query39,0.02,0.01,0.01
query40,0.02,0.01,0.01
query41,0.03,0.01,0.02
query42,0.01,0.01,0.01
query43,0.01,0.01,0.01
Total cold run time: 0.63 s
Total hot run time: 0.33 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28431:
URL: https://github.com/apache/doris/pull/28431#issuecomment-1857436816
#### `sh-checker report`
To get the full details, please check in the [job]("https://github.com/apache/doris/actions/runs/7219417264") output.
<details>
<summary>shellcheck errors</summary>
```
'shellcheck ' returned error 1 finding the following syntactical issues:
----------
In regression-test/pipeline/performance/clean.sh line 36:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 35:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 37:
source ../../common/github-utils.sh
^--------------------------^ SC1091 (info): Not following: ../../common/github-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 39:
source ../../common/oss-utils.sh
^-----------------------^ SC1091 (info): Not following: ../../common/oss-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-clickbench.sh line 50:
DORIS_HOME="${teamcity_build_checkoutDir}/output"
^--------^ SC2034 (warning): DORIS_HOME appears unused. Verify use (or export if used externally).
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 35:
source ../../common/doris-utils.sh
^-------------------------^ SC1091 (info): Not following: ../../common/doris-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 37:
source ../../common/github-utils.sh
^--------------------------^ SC1091 (info): Not following: ../../common/github-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 39:
source ../../common/oss-utils.sh
^-----------------------^ SC1091 (info): Not following: ../../common/oss-utils.sh: openBinaryFile: does not exist (No such file or directory)
In regression-test/pipeline/performance/run-tpcds-sf100.sh line 50:
DORIS_HOME="${teamcity_build_checkoutDir}/output"
^--------^ SC2034 (warning): DORIS_HOME appears unused. Verify use (or export if used externally).
For more information:
https://www.shellcheck.net/wiki/SC2034 -- DORIS_HOME appears unused. Verify...
https://www.shellcheck.net/wiki/SC1091 -- Not following: ../../common/doris...
----------
You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
# shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.
```
</details>
<details>
<summary>shfmt errors</summary>
```
'shfmt ' returned error 1 finding the following formatting issues:
----------
--- regression-test/pipeline/performance/run-tpcds-sf100.sh.orig
+++ regression-test/pipeline/performance/run-tpcds-sf100.sh
@@ -83,7 +83,7 @@
if ${DEBUG:-false}; then
SF="100"
fi
- TPCDS_DATA_DIR="/data/tpcds/sf_${SF}" # no / at the end
+ TPCDS_DATA_DIR="/data/tpcds/sf_${SF}" # no / at the end
TPCDS_DATA_DIR_LINK="${teamcity_build_checkoutDir}"/tools/tpcds-tools/bin/tpcds-data # no / at the end
db_name="tpcds_sf${SF}"
sed -i "s|^export DB=.*$|export DB='${db_name}'|g" \
----------
You can reformat the above files to meet shfmt's requirements by typing:
shfmt -w filename
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org