Skip to content

[be](chore) add some debug info to be logs#65452

Open
yiguolei wants to merge 4 commits into
apache:masterfrom
yiguolei:f2
Open

[be](chore) add some debug info to be logs#65452
yiguolei wants to merge 4 commits into
apache:masterfrom
yiguolei:f2

Conversation

@yiguolei

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

  1. print query elasped time when query context deconstructed to find if a query context elapsed too long time.
  2. add some comment about short key and sort key
  3. add some logs when thread pool is inited.

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@yiguolei yiguolei requested a review from gavinchou as a code owner July 10, 2026 07:02
@hello-stephen

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yiguolei

Copy link
Copy Markdown
Contributor Author

run buildall

@hello-stephen

Copy link
Copy Markdown
Contributor
TPC-H: Total hot run time: 29717 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 203759d8f937273c7baf73094fc9c377e2828f1c, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17769	4089	4036	4036
q2	2040	317	214	214
q3	10322	1413	830	830
q4	4678	473	339	339
q5	7502	855	578	578
q6	179	172	138	138
q7	761	841	621	621
q8	9407	1503	1768	1503
q9	6147	4458	4408	4408
q10	6780	1791	1523	1523
q11	507	347	317	317
q12	707	536	429	429
q13	18129	3375	2794	2794
q14	269	254	245	245
q15	q16	791	779	709	709
q17	1015	1007	930	930
q18	7113	5776	5506	5506
q19	1294	1185	1007	1007
q20	777	670	573	573
q21	6294	2893	2696	2696
q22	462	377	321	321
Total cold run time: 102943 ms
Total hot run time: 29717 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	5031	4715	4749	4715
q2	300	341	219	219
q3	4930	5217	4810	4810
q4	2077	2170	1347	1347
q5	4887	4725	4626	4626
q6	223	175	125	125
q7	1936	1790	1537	1537
q8	2399	2192	2117	2117
q9	7636	7217	7196	7196
q10	4680	4624	4190	4190
q11	528	386	348	348
q12	731	747	531	531
q13	2965	3358	2793	2793
q14	275	277	250	250
q15	q16	679	700	608	608
q17	1285	1267	1237	1237
q18	7306	6889	6870	6870
q19	1079	1093	1088	1088
q20	2227	2196	1919	1919
q21	5250	4649	4397	4397
q22	533	459	397	397
Total cold run time: 56957 ms
Total hot run time: 51320 ms

@hello-stephen

Copy link
Copy Markdown
Contributor
TPC-DS: Total hot run time: 179750 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 203759d8f937273c7baf73094fc9c377e2828f1c, data reload: false

query5	4314	642	495	495
query6	454	218	206	206
query7	4878	568	341	341
query8	339	188	171	171
query9	8796	4011	4047	4011
query10	462	366	329	329
query11	5919	2328	2149	2149
query12	153	101	99	99
query13	1239	572	441	441
query14	6275	5266	4952	4952
query14_1	4265	4309	4255	4255
query15	220	209	179	179
query16	1025	476	445	445
query17	906	682	568	568
query18	2419	462	343	343
query19	205	187	145	145
query20	108	107	104	104
query21	238	153	137	137
query22	13683	13546	13414	13414
query23	17312	16542	16221	16221
query23_1	16244	16349	16310	16310
query24	7562	1819	1308	1308
query24_1	1327	1327	1286	1286
query25	599	477	399	399
query26	1380	337	210	210
query27	2621	613	351	351
query28	4579	2022	2023	2022
query29	1110	660	506	506
query30	337	263	229	229
query31	1119	1096	998	998
query32	119	63	61	61
query33	559	336	263	263
query34	1233	1122	664	664
query35	793	785	686	686
query36	1428	1439	1238	1238
query37	163	113	97	97
query38	1891	1702	1652	1652
query39	939	909	890	890
query39_1	890	884	888	884
query40	256	164	138	138
query41	74	70	69	69
query42	96	99	95	95
query43	322	327	287	287
query44	1426	789	790	789
query45	203	190	178	178
query46	1059	1204	740	740
query47	2357	2357	2214	2214
query48	444	426	302	302
query49	587	434	328	328
query50	1031	412	354	354
query51	10915	10777	10632	10632
query52	89	87	78	78
query53	267	278	205	205
query54	304	243	235	235
query55	78	74	71	71
query56	315	310	289	289
query57	1450	1400	1306	1306
query58	297	263	261	261
query59	1560	1626	1417	1417
query60	319	280	262	262
query61	193	146	139	139
query62	702	646	579	579
query63	239	204	203	203
query64	2812	1041	874	874
query65	4819	4645	4803	4645
query66	1856	506	379	379
query67	29557	29420	29253	29253
query68	3514	1628	969	969
query69	431	294	272	272
query70	1064	996	955	955
query71	366	330	307	307
query72	3103	2797	2408	2408
query73	862	766	441	441
query74	5164	4938	4752	4752
query75	2601	2581	2221	2221
query76	2424	1188	775	775
query77	356	376	284	284
query78	12226	12370	11876	11876
query79	1364	1117	751	751
query80	707	545	455	455
query81	463	323	290	290
query82	903	162	119	119
query83	390	324	295	295
query84	333	160	129	129
query85	970	602	505	505
query86	462	302	276	276
query87	1829	1821	1744	1744
query88	3694	2795	2812	2795
query89	468	410	345	345
query90	1955	206	189	189
query91	203	187	165	165
query92	68	61	59	59
query93	1533	1564	899	899
query94	622	333	325	325
query95	787	494	475	475
query96	1037	810	341	341
query97	2685	2714	2541	2541
query98	213	214	193	193
query99	1151	1173	1027	1027
Total cold run time: 265913 ms
Total hot run time: 179750 ms

@hello-stephen

Copy link
Copy Markdown
Contributor
ClickBench: Total hot run time: 25.15 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 203759d8f937273c7baf73094fc9c377e2828f1c, data reload: false

query1	0.01	0.01	0.01
query2	0.10	0.05	0.05
query3	0.25	0.14	0.14
query4	1.61	0.14	0.14
query5	0.25	0.24	0.23
query6	1.26	1.05	1.08
query7	0.04	0.01	0.00
query8	0.06	0.04	0.03
query9	0.39	0.32	0.34
query10	0.56	0.57	0.59
query11	0.20	0.14	0.14
query12	0.19	0.16	0.16
query13	0.48	0.47	0.47
query14	1.03	1.00	1.00
query15	0.60	0.60	0.58
query16	0.31	0.32	0.32
query17	1.12	1.11	1.11
query18	0.23	0.22	0.23
query19	2.13	1.96	1.98
query20	0.02	0.01	0.01
query21	15.44	0.19	0.15
query22	4.98	0.05	0.06
query23	16.13	0.30	0.12
query24	3.08	0.42	0.33
query25	0.11	0.05	0.03
query26	0.75	0.20	0.15
query27	0.04	0.04	0.04
query28	3.54	0.91	0.57
query29	12.47	4.02	3.26
query30	0.27	0.15	0.15
query31	2.77	0.58	0.30
query32	3.23	0.59	0.50
query33	3.11	3.19	3.29
query34	15.59	4.24	3.51
query35	3.50	3.49	3.52
query36	0.55	0.45	0.44
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.04	0.03
query40	0.18	0.16	0.15
query41	0.08	0.03	0.04
query42	0.04	0.03	0.03
query43	0.05	0.03	0.03
Total cold run time: 96.92 s
Total hot run time: 25.15 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants