You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by jo...@apache.org on 2021/09/01 18:04:11 UTC
[impala] 03/04: IMPALA-10884: Improve pretty-printing of fragment
instance name
This is an automated email from the ASF dual-hosted git repository.
joemcdonnell pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
commit 8a6439715f3d7780a408fe97b5f80a7a9a0c57c8
Author: Riza Suminto <ri...@cloudera.com>
AuthorDate: Wed Aug 25 22:59:05 2021 -0700
IMPALA-10884: Improve pretty-printing of fragment instance name
The dense format of runtime profile print instance names in single long
lines. It is hard to observe the instance names, especially when a
fragment has many instances. This patch fixes the issue by breaking the
list into multiple lines, one line per instance. We also prefix the
instance names with an index number for easy matching against
pretty-printed counters, events, and info strings.
Testing:
- Fix and pass observability/test_profile_tool.py.
- Manually verify that impala-profile-tool prints the instance names in
multiple lines.
Change-Id: I03908ed2b29e43e133bff92c0d6480f8c5342f31
Reviewed-on: http://gerrit.cloudera.org:8080/17816
Reviewed-by: Joe McDonnell <jo...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
---
be/src/util/runtime-profile.cc | 8 ++--
...le_log_tpcds_compute_stats_default.expected.txt | 48 +++++++++++++++++++---
...e_log_tpcds_compute_stats_extended.expected.txt | 48 +++++++++++++++++++---
...log_tpcds_compute_stats_v2_default.expected.txt | 48 +++++++++++++++++++---
...og_tpcds_compute_stats_v2_extended.expected.txt | 48 +++++++++++++++++++---
5 files changed, 176 insertions(+), 24 deletions(-)
diff --git a/be/src/util/runtime-profile.cc b/be/src/util/runtime-profile.cc
index b6a200d..1585f8b 100644
--- a/be/src/util/runtime-profile.cc
+++ b/be/src/util/runtime-profile.cc
@@ -2639,10 +2639,10 @@ void AggregatedRuntimeProfile::PrettyPrintInfoStrings(
{
lock_guard<SpinLock> l(input_profile_name_lock_);
if (!input_profile_names_.empty()) {
- // TODO: IMPALA-9846: improve pretty-printing here
- stream << prefix
- << "Instances: " << boost::algorithm::join(input_profile_names_, ", ")
- << endl;
+ stream << prefix << "Instances:" << endl;
+ for (int i = 0; i < input_profile_names_.size(); ++i) {
+ stream << prefix << " [" << i << "] " << input_profile_names_[i] << endl;
+ }
}
}
diff --git a/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_default.expected.txt b/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_default.expected.txt
index fea852a..6f58622 100644
--- a/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_default.expected.txt
+++ b/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_default.expected.txt
@@ -513,7 +513,8 @@ F00:EXCHANGE SENDER 3 12 1.666ms 3.999ms 166
completion times: min:1s203ms max:1s203ms mean: 1s203ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- Instances: Instance 454fb5fa46498311:3afee31900000000 (host=tarmstrong-Precision-7540:27000)
+ Instances:
+ [0] Instance 454fb5fa46498311:3afee31900000000 (host=tarmstrong-Precision-7540:27000)
Last report received time[0]: 2020-12-15 20:07:23.281
- MemoryUsage[0] (500.000ms): 8.00 KB, 8.00 KB, 8.00 KB
Fragment Instance Lifecycle Event Timeline[0]: 1s151ms
@@ -717,7 +718,19 @@ F00:EXCHANGE SENDER 3 12 1.666ms 3.999ms 166
completion times: min:1s191ms max:1s203ms mean: 1s197ms stddev:4.149ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 12
- Instances: Instance 454fb5fa46498311:3afee3190000000d (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee3190000000e (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee3190000000f (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000010 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000011 (host=tarmstrong-Precision-7540:27000), Instance 454fb5fa46498311:3afee31900000012 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 454fb5fa46498311:3afee3190000000d (host=tarmstrong-Precision-7540:27001)
+ [1] Instance 454fb5fa46498311:3afee3190000000e (host=tarmstrong-Precision-7540:27001)
+ [2] Instance 454fb5fa46498311:3afee3190000000f (host=tarmstrong-Precision-7540:27001)
+ [3] Instance 454fb5fa46498311:3afee31900000010 (host=tarmstrong-Precision-7540:27001)
+ [4] Instance 454fb5fa46498311:3afee31900000011 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 454fb5fa46498311:3afee31900000012 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 454fb5fa46498311:3afee31900000013 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 454fb5fa46498311:3afee31900000014 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 454fb5fa46498311:3afee31900000015 (host=tarmstrong-Precision-7540:27002)
+ [9] Instance 454fb5fa46498311:3afee31900000016 (host=tarmstrong-Precision-7540:27002)
+ [10] Instance 454fb5fa46498311:3afee31900000017 (host=tarmstrong-Precision-7540:27002)
+ [11] Instance 454fb5fa46498311:3afee31900000018 (host=tarmstrong-Precision-7540:27002)
Last report received time[8-11]: 2020-12-15 20:07:23.272
Last report received time[0-3]: 2020-12-15 20:07:23.276
Last report received time[4-7]: 2020-12-15 20:07:23.281
@@ -3092,7 +3105,19 @@ F00:EXCHANGE SENDER 3 12 1.666ms 3.999ms 166
completion times: min:1s191ms max:1s203ms mean: 1s197ms stddev:4.149ms
execution rates: min:13.22 MB/sec max:17.54 MB/sec mean:13.70 MB/sec stddev:1.16 MB/sec
num instances: 12
- Instances: Instance 454fb5fa46498311:3afee31900000001 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000002 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000003 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000004 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000005 (host=tarmstrong-Precision-7540:27000), Instance 454fb5fa46498311:3afee31900000006 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 454fb5fa46498311:3afee31900000001 (host=tarmstrong-Precision-7540:27001)
+ [1] Instance 454fb5fa46498311:3afee31900000002 (host=tarmstrong-Precision-7540:27001)
+ [2] Instance 454fb5fa46498311:3afee31900000003 (host=tarmstrong-Precision-7540:27001)
+ [3] Instance 454fb5fa46498311:3afee31900000004 (host=tarmstrong-Precision-7540:27001)
+ [4] Instance 454fb5fa46498311:3afee31900000005 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 454fb5fa46498311:3afee31900000006 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 454fb5fa46498311:3afee31900000007 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 454fb5fa46498311:3afee31900000008 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 454fb5fa46498311:3afee31900000009 (host=tarmstrong-Precision-7540:27002)
+ [9] Instance 454fb5fa46498311:3afee3190000000a (host=tarmstrong-Precision-7540:27002)
+ [10] Instance 454fb5fa46498311:3afee3190000000b (host=tarmstrong-Precision-7540:27002)
+ [11] Instance 454fb5fa46498311:3afee3190000000c (host=tarmstrong-Precision-7540:27002)
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB
@@ -6261,7 +6286,8 @@ F00:EXCHANGE SENDER 3 12 0.000ns 0.000ns
completion times: min:3s863ms max:3s863ms mean: 3s863ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- Instances: Instance da4f8f953162a9b0:9a4d93eb00000000 (host=tarmstrong-Precision-7540:27000)
+ Instances:
+ [0] Instance da4f8f953162a9b0:9a4d93eb00000000 (host=tarmstrong-Precision-7540:27000)
Last report received time[0]: 2020-12-15 20:07:27.327
- MemoryUsage[0] (500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB
Fragment Instance Lifecycle Event Timeline[0]: 3s819ms
@@ -6504,7 +6530,19 @@ F00:EXCHANGE SENDER 3 12 0.000ns 0.000ns
completion times: min:3s731ms max:3s863ms mean: 3s816ms stddev:58.197ms
execution rates: min:4.12 MB/sec max:5.47 MB/sec mean:4.30 MB/sec stddev:365.33 KB/sec
num instances: 12
- Instances: Instance da4f8f953162a9b0:9a4d93eb00000001 (host=tarmstrong-Precision-7540:27001), Instance da4f8f953162a9b0:9a4d93eb00000002 (host=tarmstrong-Precision-7540:27001), Instance da4f8f953162a9b0:9a4d93eb00000003 (host=tarmstrong-Precision-7540:27001), Instance da4f8f953162a9b0:9a4d93eb00000004 (host=tarmstrong-Precision-7540:27001), Instance da4f8f953162a9b0:9a4d93eb00000005 (host=tarmstrong-Precision-7540:27000), Instance da4f8f953162a9b0:9a4d93eb00000006 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance da4f8f953162a9b0:9a4d93eb00000001 (host=tarmstrong-Precision-7540:27001)
+ [1] Instance da4f8f953162a9b0:9a4d93eb00000002 (host=tarmstrong-Precision-7540:27001)
+ [2] Instance da4f8f953162a9b0:9a4d93eb00000003 (host=tarmstrong-Precision-7540:27001)
+ [3] Instance da4f8f953162a9b0:9a4d93eb00000004 (host=tarmstrong-Precision-7540:27001)
+ [4] Instance da4f8f953162a9b0:9a4d93eb00000005 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance da4f8f953162a9b0:9a4d93eb00000006 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance da4f8f953162a9b0:9a4d93eb00000007 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance da4f8f953162a9b0:9a4d93eb00000008 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance da4f8f953162a9b0:9a4d93eb00000009 (host=tarmstrong-Precision-7540:27002)
+ [9] Instance da4f8f953162a9b0:9a4d93eb0000000a (host=tarmstrong-Precision-7540:27002)
+ [10] Instance da4f8f953162a9b0:9a4d93eb0000000b (host=tarmstrong-Precision-7540:27002)
+ [11] Instance da4f8f953162a9b0:9a4d93eb0000000c (host=tarmstrong-Precision-7540:27002)
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB
diff --git a/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_extended.expected.txt b/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_extended.expected.txt
index b320057..327ead6 100644
--- a/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_extended.expected.txt
+++ b/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_extended.expected.txt
@@ -513,7 +513,8 @@ F00:EXCHANGE SENDER 3 12 1.666ms 3.999ms 166
completion times: min:1s203ms max:1s203ms mean: 1s203ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- Instances: Instance 454fb5fa46498311:3afee31900000000 (host=tarmstrong-Precision-7540:27000)
+ Instances:
+ [0] Instance 454fb5fa46498311:3afee31900000000 (host=tarmstrong-Precision-7540:27000)
Last report received time[0]: 2020-12-15 20:07:23.281
- MemoryUsage[0] (500.000ms): 8.00 KB, 8.00 KB, 8.00 KB
Fragment Instance Lifecycle Event Timeline[0]: 1s151ms
@@ -717,7 +718,19 @@ F00:EXCHANGE SENDER 3 12 1.666ms 3.999ms 166
completion times: min:1s191ms max:1s203ms mean: 1s197ms stddev:4.149ms
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 12
- Instances: Instance 454fb5fa46498311:3afee3190000000d (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee3190000000e (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee3190000000f (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000010 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000011 (host=tarmstrong-Precision-7540:27000), Instance 454fb5fa46498311:3afee31900000012 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 454fb5fa46498311:3afee3190000000d (host=tarmstrong-Precision-7540:27001)
+ [1] Instance 454fb5fa46498311:3afee3190000000e (host=tarmstrong-Precision-7540:27001)
+ [2] Instance 454fb5fa46498311:3afee3190000000f (host=tarmstrong-Precision-7540:27001)
+ [3] Instance 454fb5fa46498311:3afee31900000010 (host=tarmstrong-Precision-7540:27001)
+ [4] Instance 454fb5fa46498311:3afee31900000011 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 454fb5fa46498311:3afee31900000012 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 454fb5fa46498311:3afee31900000013 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 454fb5fa46498311:3afee31900000014 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 454fb5fa46498311:3afee31900000015 (host=tarmstrong-Precision-7540:27002)
+ [9] Instance 454fb5fa46498311:3afee31900000016 (host=tarmstrong-Precision-7540:27002)
+ [10] Instance 454fb5fa46498311:3afee31900000017 (host=tarmstrong-Precision-7540:27002)
+ [11] Instance 454fb5fa46498311:3afee31900000018 (host=tarmstrong-Precision-7540:27002)
Last report received time[8-11]: 2020-12-15 20:07:23.272
Last report received time[0-3]: 2020-12-15 20:07:23.276
Last report received time[4-7]: 2020-12-15 20:07:23.281
@@ -3290,7 +3303,19 @@ F00:EXCHANGE SENDER 3 12 1.666ms 3.999ms 166
completion times: min:1s191ms max:1s203ms mean: 1s197ms stddev:4.149ms
execution rates: min:13.22 MB/sec max:17.54 MB/sec mean:13.70 MB/sec stddev:1.16 MB/sec
num instances: 12
- Instances: Instance 454fb5fa46498311:3afee31900000001 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000002 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000003 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000004 (host=tarmstrong-Precision-7540:27001), Instance 454fb5fa46498311:3afee31900000005 (host=tarmstrong-Precision-7540:27000), Instance 454fb5fa46498311:3afee31900000006 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 454fb5fa46498311:3afee31900000001 (host=tarmstrong-Precision-7540:27001)
+ [1] Instance 454fb5fa46498311:3afee31900000002 (host=tarmstrong-Precision-7540:27001)
+ [2] Instance 454fb5fa46498311:3afee31900000003 (host=tarmstrong-Precision-7540:27001)
+ [3] Instance 454fb5fa46498311:3afee31900000004 (host=tarmstrong-Precision-7540:27001)
+ [4] Instance 454fb5fa46498311:3afee31900000005 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 454fb5fa46498311:3afee31900000006 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 454fb5fa46498311:3afee31900000007 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 454fb5fa46498311:3afee31900000008 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 454fb5fa46498311:3afee31900000009 (host=tarmstrong-Precision-7540:27002)
+ [9] Instance 454fb5fa46498311:3afee3190000000a (host=tarmstrong-Precision-7540:27002)
+ [10] Instance 454fb5fa46498311:3afee3190000000b (host=tarmstrong-Precision-7540:27002)
+ [11] Instance 454fb5fa46498311:3afee3190000000c (host=tarmstrong-Precision-7540:27002)
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB
@@ -6763,7 +6788,8 @@ F00:EXCHANGE SENDER 3 12 0.000ns 0.000ns
completion times: min:3s863ms max:3s863ms mean: 3s863ms stddev:0.000ns
execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec
num instances: 1
- Instances: Instance da4f8f953162a9b0:9a4d93eb00000000 (host=tarmstrong-Precision-7540:27000)
+ Instances:
+ [0] Instance da4f8f953162a9b0:9a4d93eb00000000 (host=tarmstrong-Precision-7540:27000)
Last report received time[0]: 2020-12-15 20:07:27.327
- MemoryUsage[0] (500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB
Fragment Instance Lifecycle Event Timeline[0]: 3s819ms
@@ -7006,7 +7032,19 @@ F00:EXCHANGE SENDER 3 12 0.000ns 0.000ns
completion times: min:3s731ms max:3s863ms mean: 3s816ms stddev:58.197ms
execution rates: min:4.12 MB/sec max:5.47 MB/sec mean:4.30 MB/sec stddev:365.33 KB/sec
num instances: 12
- Instances: Instance da4f8f953162a9b0:9a4d93eb00000001 (host=tarmstrong-Precision-7540:27001), Instance da4f8f953162a9b0:9a4d93eb00000002 (host=tarmstrong-Precision-7540:27001), Instance da4f8f953162a9b0:9a4d93eb00000003 (host=tarmstrong-Precision-7540:27001), Instance da4f8f953162a9b0:9a4d93eb00000004 (host=tarmstrong-Precision-7540:27001), Instance da4f8f953162a9b0:9a4d93eb00000005 (host=tarmstrong-Precision-7540:27000), Instance da4f8f953162a9b0:9a4d93eb00000006 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance da4f8f953162a9b0:9a4d93eb00000001 (host=tarmstrong-Precision-7540:27001)
+ [1] Instance da4f8f953162a9b0:9a4d93eb00000002 (host=tarmstrong-Precision-7540:27001)
+ [2] Instance da4f8f953162a9b0:9a4d93eb00000003 (host=tarmstrong-Precision-7540:27001)
+ [3] Instance da4f8f953162a9b0:9a4d93eb00000004 (host=tarmstrong-Precision-7540:27001)
+ [4] Instance da4f8f953162a9b0:9a4d93eb00000005 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance da4f8f953162a9b0:9a4d93eb00000006 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance da4f8f953162a9b0:9a4d93eb00000007 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance da4f8f953162a9b0:9a4d93eb00000008 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance da4f8f953162a9b0:9a4d93eb00000009 (host=tarmstrong-Precision-7540:27002)
+ [9] Instance da4f8f953162a9b0:9a4d93eb0000000a (host=tarmstrong-Precision-7540:27002)
+ [10] Instance da4f8f953162a9b0:9a4d93eb0000000b (host=tarmstrong-Precision-7540:27002)
+ [11] Instance da4f8f953162a9b0:9a4d93eb0000000c (host=tarmstrong-Precision-7540:27002)
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB
diff --git a/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_v2_default.expected.txt b/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_v2_default.expected.txt
index 9d15fbc..13c42fd 100644
--- a/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_v2_default.expected.txt
+++ b/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_v2_default.expected.txt
@@ -509,7 +509,8 @@ F00:EXCHANGE SENDER 3 12 1.356ms 6.539ms 1
- PrepareTime: 27.139ms
- TotalTime: 112.612ms
Coordinator Fragment F02:
- Instances: Instance 874b65988023a32b:71d209e900000000 (host=tarmstrong-Precision-7540:27000)
+ Instances:
+ [0] Instance 874b65988023a32b:71d209e900000000 (host=tarmstrong-Precision-7540:27000)
Last report received time[0]: 2021-02-09 08:53:03.675
- MemoryUsage[0] (500.000ms): 8.00 KB, 8.00 KB, 8.00 KB
Fragment Instance Lifecycle Event Timeline[0]: 1s208ms
@@ -608,7 +609,19 @@ F00:EXCHANGE SENDER 3 12 1.356ms 6.539ms 1
- TotalRPCsDeferred: 0 (0)
- TotalTime: 0.000ns
Fragment F01 [12 instances]:
- Instances: Instance 874b65988023a32b:71d209e90000000d (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e90000000e (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e90000000f (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000010 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000011 (host=tarmstrong-Precision-7540:27000), Instance 874b65988023a32b:71d209e900000012 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 874b65988023a32b:71d209e90000000d (host=tarmstrong-Precision-7540:27002)
+ [1] Instance 874b65988023a32b:71d209e90000000e (host=tarmstrong-Precision-7540:27002)
+ [2] Instance 874b65988023a32b:71d209e90000000f (host=tarmstrong-Precision-7540:27002)
+ [3] Instance 874b65988023a32b:71d209e900000010 (host=tarmstrong-Precision-7540:27002)
+ [4] Instance 874b65988023a32b:71d209e900000011 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 874b65988023a32b:71d209e900000012 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 874b65988023a32b:71d209e900000013 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 874b65988023a32b:71d209e900000014 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 874b65988023a32b:71d209e900000015 (host=tarmstrong-Precision-7540:27001)
+ [9] Instance 874b65988023a32b:71d209e900000016 (host=tarmstrong-Precision-7540:27001)
+ [10] Instance 874b65988023a32b:71d209e900000017 (host=tarmstrong-Precision-7540:27001)
+ [11] Instance 874b65988023a32b:71d209e900000018 (host=tarmstrong-Precision-7540:27001)
Last report received time[0-3]: 2021-02-09 08:53:03.669
Last report received time[8-11]: 2021-02-09 08:53:03.674
Last report received time[4-7]: 2021-02-09 08:53:03.675
@@ -996,7 +1009,19 @@ F00:EXCHANGE SENDER 3 12 1.356ms 6.539ms 1
- TotalRPCsDeferred: mean=0 (0) min=0 (0) max=0 (0)
- TotalTime: mean=0.000ns min=0.000ns max=0.000ns
Fragment F00 [12 instances]:
- Instances: Instance 874b65988023a32b:71d209e900000001 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000002 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000003 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000004 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000005 (host=tarmstrong-Precision-7540:27000), Instance 874b65988023a32b:71d209e900000006 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 874b65988023a32b:71d209e900000001 (host=tarmstrong-Precision-7540:27002)
+ [1] Instance 874b65988023a32b:71d209e900000002 (host=tarmstrong-Precision-7540:27002)
+ [2] Instance 874b65988023a32b:71d209e900000003 (host=tarmstrong-Precision-7540:27002)
+ [3] Instance 874b65988023a32b:71d209e900000004 (host=tarmstrong-Precision-7540:27002)
+ [4] Instance 874b65988023a32b:71d209e900000005 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 874b65988023a32b:71d209e900000006 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 874b65988023a32b:71d209e900000007 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 874b65988023a32b:71d209e900000008 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 874b65988023a32b:71d209e900000009 (host=tarmstrong-Precision-7540:27001)
+ [9] Instance 874b65988023a32b:71d209e90000000a (host=tarmstrong-Precision-7540:27001)
+ [10] Instance 874b65988023a32b:71d209e90000000b (host=tarmstrong-Precision-7540:27001)
+ [11] Instance 874b65988023a32b:71d209e90000000c (host=tarmstrong-Precision-7540:27001)
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB
@@ -1861,7 +1886,8 @@ F00:EXCHANGE SENDER 3 12 265.136us 490.561us
- PrepareTime: 16.210ms
- TotalTime: 369.983ms
Coordinator Fragment F01:
- Instances: Instance 504e9a5d292585e8:7c56749700000000 (host=tarmstrong-Precision-7540:27000)
+ Instances:
+ [0] Instance 504e9a5d292585e8:7c56749700000000 (host=tarmstrong-Precision-7540:27000)
Last report received time[0]: 2021-02-09 08:53:08.375
- MemoryUsage[0] (500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB
Fragment Instance Lifecycle Event Timeline[0]: 4s434ms
@@ -1979,7 +2005,19 @@ F00:EXCHANGE SENDER 3 12 265.136us 490.561us
- TotalRPCsDeferred: 0 (0)
- TotalTime: 0.000ns
Fragment F00 [12 instances]:
- Instances: Instance 504e9a5d292585e8:7c56749700000001 (host=tarmstrong-Precision-7540:27002), Instance 504e9a5d292585e8:7c56749700000002 (host=tarmstrong-Precision-7540:27002), Instance 504e9a5d292585e8:7c56749700000003 (host=tarmstrong-Precision-7540:27002), Instance 504e9a5d292585e8:7c56749700000004 (host=tarmstrong-Precision-7540:27002), Instance 504e9a5d292585e8:7c56749700000005 (host=tarmstrong-Precision-7540:27000), Instance 504e9a5d292585e8:7c56749700000006 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 504e9a5d292585e8:7c56749700000001 (host=tarmstrong-Precision-7540:27002)
+ [1] Instance 504e9a5d292585e8:7c56749700000002 (host=tarmstrong-Precision-7540:27002)
+ [2] Instance 504e9a5d292585e8:7c56749700000003 (host=tarmstrong-Precision-7540:27002)
+ [3] Instance 504e9a5d292585e8:7c56749700000004 (host=tarmstrong-Precision-7540:27002)
+ [4] Instance 504e9a5d292585e8:7c56749700000005 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 504e9a5d292585e8:7c56749700000006 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 504e9a5d292585e8:7c56749700000007 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 504e9a5d292585e8:7c56749700000008 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 504e9a5d292585e8:7c56749700000009 (host=tarmstrong-Precision-7540:27001)
+ [9] Instance 504e9a5d292585e8:7c5674970000000a (host=tarmstrong-Precision-7540:27001)
+ [10] Instance 504e9a5d292585e8:7c5674970000000b (host=tarmstrong-Precision-7540:27001)
+ [11] Instance 504e9a5d292585e8:7c5674970000000c (host=tarmstrong-Precision-7540:27001)
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB
diff --git a/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_v2_extended.expected.txt b/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_v2_extended.expected.txt
index 28d0340..99b674f 100644
--- a/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_v2_extended.expected.txt
+++ b/testdata/impala-profiles/impala_profile_log_tpcds_compute_stats_v2_extended.expected.txt
@@ -509,7 +509,8 @@ F00:EXCHANGE SENDER 3 12 1.356ms 6.539ms 1
- PrepareTime: 27.139ms
- TotalTime: 112.612ms
Coordinator Fragment F02:
- Instances: Instance 874b65988023a32b:71d209e900000000 (host=tarmstrong-Precision-7540:27000)
+ Instances:
+ [0] Instance 874b65988023a32b:71d209e900000000 (host=tarmstrong-Precision-7540:27000)
Last report received time[0]: 2021-02-09 08:53:03.675
- MemoryUsage[0] (500.000ms): 8.00 KB, 8.00 KB, 8.00 KB
Fragment Instance Lifecycle Event Timeline[0]: 1s208ms
@@ -608,7 +609,19 @@ F00:EXCHANGE SENDER 3 12 1.356ms 6.539ms 1
- TotalRPCsDeferred: 0 (0)
- TotalTime: 0.000ns
Fragment F01 [12 instances]:
- Instances: Instance 874b65988023a32b:71d209e90000000d (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e90000000e (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e90000000f (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000010 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000011 (host=tarmstrong-Precision-7540:27000), Instance 874b65988023a32b:71d209e900000012 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 874b65988023a32b:71d209e90000000d (host=tarmstrong-Precision-7540:27002)
+ [1] Instance 874b65988023a32b:71d209e90000000e (host=tarmstrong-Precision-7540:27002)
+ [2] Instance 874b65988023a32b:71d209e90000000f (host=tarmstrong-Precision-7540:27002)
+ [3] Instance 874b65988023a32b:71d209e900000010 (host=tarmstrong-Precision-7540:27002)
+ [4] Instance 874b65988023a32b:71d209e900000011 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 874b65988023a32b:71d209e900000012 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 874b65988023a32b:71d209e900000013 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 874b65988023a32b:71d209e900000014 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 874b65988023a32b:71d209e900000015 (host=tarmstrong-Precision-7540:27001)
+ [9] Instance 874b65988023a32b:71d209e900000016 (host=tarmstrong-Precision-7540:27001)
+ [10] Instance 874b65988023a32b:71d209e900000017 (host=tarmstrong-Precision-7540:27001)
+ [11] Instance 874b65988023a32b:71d209e900000018 (host=tarmstrong-Precision-7540:27001)
Last report received time[0-3]: 2021-02-09 08:53:03.669
Last report received time[8-11]: 2021-02-09 08:53:03.674
Last report received time[4-7]: 2021-02-09 08:53:03.675
@@ -1202,7 +1215,19 @@ F00:EXCHANGE SENDER 3 12 1.356ms 6.539ms 1
- TotalRPCsDeferred: mean=0 (0) min=0 (0) p50=0 (0) p75=0 (0) p90=0 (0) p95=0 (0) max=0 (0)
- TotalTime: mean=0.000ns min=0.000ns p50=0.000ns p75=0.000ns p90=0.000ns p95=0.000ns max=0.000ns
Fragment F00 [12 instances]:
- Instances: Instance 874b65988023a32b:71d209e900000001 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000002 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000003 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000004 (host=tarmstrong-Precision-7540:27002), Instance 874b65988023a32b:71d209e900000005 (host=tarmstrong-Precision-7540:27000), Instance 874b65988023a32b:71d209e900000006 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 874b65988023a32b:71d209e900000001 (host=tarmstrong-Precision-7540:27002)
+ [1] Instance 874b65988023a32b:71d209e900000002 (host=tarmstrong-Precision-7540:27002)
+ [2] Instance 874b65988023a32b:71d209e900000003 (host=tarmstrong-Precision-7540:27002)
+ [3] Instance 874b65988023a32b:71d209e900000004 (host=tarmstrong-Precision-7540:27002)
+ [4] Instance 874b65988023a32b:71d209e900000005 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 874b65988023a32b:71d209e900000006 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 874b65988023a32b:71d209e900000007 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 874b65988023a32b:71d209e900000008 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 874b65988023a32b:71d209e900000009 (host=tarmstrong-Precision-7540:27001)
+ [9] Instance 874b65988023a32b:71d209e90000000a (host=tarmstrong-Precision-7540:27001)
+ [10] Instance 874b65988023a32b:71d209e90000000b (host=tarmstrong-Precision-7540:27001)
+ [11] Instance 874b65988023a32b:71d209e90000000c (host=tarmstrong-Precision-7540:27001)
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB
@@ -2379,7 +2404,8 @@ F00:EXCHANGE SENDER 3 12 265.136us 490.561us
- PrepareTime: 16.210ms
- TotalTime: 369.983ms
Coordinator Fragment F01:
- Instances: Instance 504e9a5d292585e8:7c56749700000000 (host=tarmstrong-Precision-7540:27000)
+ Instances:
+ [0] Instance 504e9a5d292585e8:7c56749700000000 (host=tarmstrong-Precision-7540:27000)
Last report received time[0]: 2021-02-09 08:53:08.375
- MemoryUsage[0] (500.000ms): 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB, 12.00 KB
Fragment Instance Lifecycle Event Timeline[0]: 4s434ms
@@ -2497,7 +2523,19 @@ F00:EXCHANGE SENDER 3 12 265.136us 490.561us
- TotalRPCsDeferred: 0 (0)
- TotalTime: 0.000ns
Fragment F00 [12 instances]:
- Instances: Instance 504e9a5d292585e8:7c56749700000001 (host=tarmstrong-Precision-7540:27002), Instance 504e9a5d292585e8:7c56749700000002 (host=tarmstrong-Precision-7540:27002), Instance 504e9a5d292585e8:7c56749700000003 (host=tarmstrong-Precision-7540:27002), Instance 504e9a5d292585e8:7c56749700000004 (host=tarmstrong-Precision-7540:27002), Instance 504e9a5d292585e8:7c56749700000005 (host=tarmstrong-Precision-7540:27000), Instance 504e9a5d292585e8:7c56749700000006 (host=tarmstrong-Pr [...]
+ Instances:
+ [0] Instance 504e9a5d292585e8:7c56749700000001 (host=tarmstrong-Precision-7540:27002)
+ [1] Instance 504e9a5d292585e8:7c56749700000002 (host=tarmstrong-Precision-7540:27002)
+ [2] Instance 504e9a5d292585e8:7c56749700000003 (host=tarmstrong-Precision-7540:27002)
+ [3] Instance 504e9a5d292585e8:7c56749700000004 (host=tarmstrong-Precision-7540:27002)
+ [4] Instance 504e9a5d292585e8:7c56749700000005 (host=tarmstrong-Precision-7540:27000)
+ [5] Instance 504e9a5d292585e8:7c56749700000006 (host=tarmstrong-Precision-7540:27000)
+ [6] Instance 504e9a5d292585e8:7c56749700000007 (host=tarmstrong-Precision-7540:27000)
+ [7] Instance 504e9a5d292585e8:7c56749700000008 (host=tarmstrong-Precision-7540:27000)
+ [8] Instance 504e9a5d292585e8:7c56749700000009 (host=tarmstrong-Precision-7540:27001)
+ [9] Instance 504e9a5d292585e8:7c5674970000000a (host=tarmstrong-Precision-7540:27001)
+ [10] Instance 504e9a5d292585e8:7c5674970000000b (host=tarmstrong-Precision-7540:27001)
+ [11] Instance 504e9a5d292585e8:7c5674970000000c (host=tarmstrong-Precision-7540:27001)
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[11]: 0:152/15.76 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[9]: 0:152/15.86 MB
Hdfs split stats (<volume id>:<# splits>/<split lengths>)[0]: 0:152/15.87 MB