You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "HappenLee (via GitHub)" <gi...@apache.org> on 2024/01/20 19:30:14 UTC

[PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

HappenLee opened a new pull request, #30190:
URL: https://github.com/apache/doris/pull/30190

   ## Proposed changes
   
   Issue Number: close #xxx
   
   <!--Describe your changes.-->
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30190:
URL: https://github.com/apache/doris/pull/30190#issuecomment-1902484575

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "HappenLee (via GitHub)" <gi...@apache.org>.
HappenLee commented on PR #30190:
URL: https://github.com/apache/doris/pull/30190#issuecomment-1902246799

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30190:
URL: https://github.com/apache/doris/pull/30190#issuecomment-1902248585

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30190:
URL: https://github.com/apache/doris/pull/30190#issuecomment-1902257016

   
   Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Load test result on commit a2044991381cf2593386e55d4d3a2eabb3d7038b with default session variables
   Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
   Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
   Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
   Insert into select:       15.0 seconds inserted 10000000 Rows, about 666K ops/s
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30190:
URL: https://github.com/apache/doris/pull/30190#issuecomment-1902252697

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 38757 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit a2044991381cf2593386e55d4d3a2eabb3d7038b, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17660	5349	5245	5245
   q2	2045	137	132	132
   q3	10814	1159	1138	1138
   q4	10435	789	866	789
   q5	7735	3133	3120	3120
   q6	199	120	122	120
   q7	861	507	480	480
   q8	9227	1941	1958	1941
   q9	7274	6341	6308	6308
   q10	8230	3050	3100	3050
   q11	421	218	205	205
   q12	358	195	199	195
   q13	17989	3357	3339	3339
   q14	244	222	210	210
   q15	540	515	498	498
   q16	429	398	409	398
   q17	925	521	531	521
   q18	7676	6957	6679	6679
   q19	1540	1399	1387	1387
   q20	597	302	303	302
   q21	2771	2385	2425	2385
   q22	366	319	315	315
   Total cold run time: 108336 ms
   Total hot run time: 38757 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5435	5306	5321	5306
   q2	328	219	213	213
   q3	3301	3258	3236	3236
   q4	2020	2043	2032	2032
   q5	5848	5884	5814	5814
   q6	200	120	118	118
   q7	2259	1891	1942	1891
   q8	3202	3355	3376	3355
   q9	8970	8804	8703	8703
   q10	3924	3854	3787	3787
   q11	555	460	455	455
   q12	822	620	635	620
   q13	17102	3158	3143	3143
   q14	281	263	254	254
   q15	559	510	502	502
   q16	516	476	474	474
   q17	1869	1895	1872	1872
   q18	9386	15455	9876	9876
   q19	21518	1588	1504	1504
   q20	5146	1958	1965	1958
   q21	14800	5499	5344	5344
   q22	1017	504	572	504
   Total cold run time: 109058 ms
   Total hot run time: 60961 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30190:
URL: https://github.com/apache/doris/pull/30190#issuecomment-1902252642

   TeamCity be ut coverage result:
    Function Coverage: 36.73% (8655/23567) 
    Line Coverage: 28.77% (70702/245748)
    Region Coverage: 27.65% (36456/131870)
    Branch Coverage: 24.38% (18665/76568)
    Coverage Report: http://coverage.selectdb-in.cc/coverage/a2044991381cf2593386e55d4d3a2eabb3d7038b_a2044991381cf2593386e55d4d3a2eabb3d7038b/report/index.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30190:
URL: https://github.com/apache/doris/pull/30190#issuecomment-1902255361

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 176485 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit a2044991381cf2593386e55d4d3a2eabb3d7038b, data reload: false
   
   query1	939	327	328	327
   query2	7877	2097	1933	1933
   query3	8012	213	206	206
   query4	33171	22218	22168	22168
   query5	6913	600	582	582
   query6	242	179	154	154
   query7	4607	267	266	266
   query8	216	170	175	170
   query9	8358	2531	2479	2479
   query10	422	224	214	214
   query11	16987	15540	15458	15458
   query12	121	68	68	68
   query13	1679	380	376	376
   query14	10582	7001	6876	6876
   query15	207	181	185	181
   query16	4607	240	226	226
   query17	989	465	463	463
   query18	1777	260	252	252
   query19	169	133	132	132
   query20	72	73	66	66
   query21	187	133	126	126
   query22	4916	4779	4725	4725
   query23	31549	31009	30926	30926
   query24	12903	2843	2763	2763
   query25	574	314	306	306
   query26	1836	150	138	138
   query27	3569	265	274	265
   query28	7418	1824	1807	1807
   query29	2166	638	612	612
   query30	285	138	148	138
   query31	929	730	774	730
   query32	74	48	51	48
   query33	720	212	212	212
   query34	1301	458	465	458
   query35	881	756	752	752
   query36	1291	1244	1200	1200
   query37	174	56	58	56
   query38	3409	3250	3202	3202
   query39	1304	1247	1256	1247
   query40	341	90	87	87
   query41	38	36	35	35
   query42	101	80	79	79
   query43	523	452	482	452
   query44	1135	684	686	684
   query45	198	180	173	173
   query46	1072	656	658	656
   query47	1670	1582	1580	1580
   query48	397	300	315	300
   query49	1235	282	285	282
   query50	689	311	309	309
   query51	5313	5187	5240	5187
   query52	93	77	80	77
   query53	319	255	255	255
   query54	464	288	293	288
   query55	82	75	72	72
   query56	177	170	164	164
   query57	980	893	968	893
   query58	186	155	160	155
   query59	2903	2699	2661	2661
   query60	211	188	183	183
   query61	91	87	84	84
   query62	615	361	353	353
   query63	279	263	260	260
   query64	6098	1779	1746	1746
   query65	3345	3234	3254	3234
   query66	1397	316	313	313
   query67	15839	15227	15096	15096
   query68	12288	501	499	499
   query69	609	308	299	299
   query70	1656	1552	1480	1480
   query71	539	208	205	205
   query72	4819	2828	2855	2828
   query73	2615	304	321	304
   query74	7049	6359	6433	6359
   query75	5023	2336	2327	2327
   query76	6647	1020	1019	1019
   query77	640	224	235	224
   query78	9252	8867	8505	8505
   query79	5283	489	501	489
   query80	705	318	308	308
   query81	447	204	208	204
   query82	284	85	79	79
   query83	143	120	114	114
   query84	285	73	73	73
   query85	1105	340	316	316
   query86	408	399	392	392
   query87	3545	3321	3329	3321
   query88	3697	2197	2171	2171
   query89	449	347	332	332
   query90	2029	186	185	185
   query91	157	131	133	131
   query92	52	43	47	43
   query93	3548	425	430	425
   query94	1206	158	155	155
   query95	506	456	452	452
   query96	638	324	313	313
   query97	4199	4109	4144	4109
   query98	200	199	181	181
   query99	1069	677	704	677
   Total cold run time: 310316 ms
   Total hot run time: 176485 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30190:
URL: https://github.com/apache/doris/pull/30190#issuecomment-1902256389

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 31.14 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit a2044991381cf2593386e55d4d3a2eabb3d7038b, data reload: false
   
   query1	0.03	0.03	0.03
   query2	0.06	0.02	0.02
   query3	0.22	0.05	0.05
   query4	1.71	0.06	0.07
   query5	0.53	0.52	0.52
   query6	1.33	0.64	0.64
   query7	0.02	0.01	0.01
   query8	0.04	0.03	0.03
   query9	0.55	0.51	0.50
   query10	0.56	0.57	0.56
   query11	0.12	0.09	0.09
   query12	0.11	0.09	0.08
   query13	0.61	0.60	0.60
   query14	0.81	0.79	0.79
   query15	0.79	0.77	0.77
   query16	0.39	0.40	0.38
   query17	1.03	1.01	1.03
   query18	0.26	0.24	0.25
   query19	1.86	1.77	1.82
   query20	0.01	0.01	0.01
   query21	15.40	0.57	0.57
   query22	2.39	3.05	1.92
   query23	17.55	0.80	0.75
   query24	2.24	1.21	1.28
   query25	0.32	0.14	0.20
   query26	0.60	0.13	0.13
   query27	0.06	0.06	0.05
   query28	11.18	0.76	0.78
   query29	12.48	3.25	3.11
   query30	0.54	0.45	0.47
   query31	2.78	0.34	0.35
   query32	3.39	0.49	0.48
   query33	3.23	3.24	3.24
   query34	15.83	4.36	4.25
   query35	4.33	4.29	4.26
   query36	1.11	1.07	1.07
   query37	0.06	0.05	0.05
   query38	0.03	0.03	0.03
   query39	0.02	0.02	0.01
   query40	0.17	0.12	0.13
   query41	0.07	0.02	0.02
   query42	0.02	0.02	0.01
   query43	0.03	0.02	0.01
   Total cold run time: 104.87 s
   Total hot run time: 31.14 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30190:
URL: https://github.com/apache/doris/pull/30190#issuecomment-1902470126

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Bug](fix) try to fix the coredump of streambyte decode of sse [doris]

Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #30190:
URL: https://github.com/apache/doris/pull/30190


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org