You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by "Juan Yu (Code Review)" <ge...@cloudera.org> on 2016/03/18 07:09:43 UTC
[Impala-CR](cdh5-trunk) PREVIEW IMPALA-2076: Part2 - Show DataStreamSender in ExecSummary under EXCHANGE node.
Juan Yu has uploaded a new change for review.
http://gerrit.cloudera.org:8080/2579
Change subject: PREVIEW IMPALA-2076: Part2 - Show DataStreamSender in ExecSummary under EXCHANGE node.
......................................................................
PREVIEW IMPALA-2076: Part2 - Show DataStreamSender in ExecSummary under EXCHANGE node.
ExecSummary only shows summary for plan node. DataStreamSender is not
a plan node. Modified TExecSummary to include a data_stream_sender_map
so Impala could track DataStreamSender summary and provide more insight
about network traffic.
Here is an example of new ExecSummary:
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
---------------------------------------------------------------------------------------------------------------------------------
07:AGGREGATE 1 91.807ms 91.807ms 1 1 20.00 KB -1.00 B FINALIZE
06:EXCHANGE 1 255.625us 255.625us 2 1 0 -1.00 B UNPARTITIONED
|--DataStreamSender 2 184.988us 185.751us 2 -1 16.00 KB -1.00 B DataStreamSender (dst_id=6)
03:AGGREGATE 2 3s336ms 3s422ms 2 1 94.59 KB 10.00 MB
02:HASH JOIN 2 1m15s 1m15s 1.93B 1.50M 1.01 GB 396.52 MB INNER JOIN, PARTITIONED
|--05:EXCHANGE 2 2s743ms 2s783ms 15.75M 15.75M 0 0 HASH(b.medallion)
| |--DataStreamSender 3 3s872ms 4s172ms 15.75M -1 130.66 KB -1.00 B DataStreamSender (dst_id=5)
| 01:SCAN HDFS 3 789.420ms 833.881ms 15.75M 15.75M 14.32 MB 80.00 MB default.trip_fare_parquet b
04:EXCHANGE 2 128.059ms 142.198ms 1.50M 1.50M 0 0 HASH(s.medallion)
|--DataStreamSender 2 563.868ms 828.027ms 1.50M -1 130.66 KB -1.00 B DataStreamSender (dst_id=4)
00:SCAN HDFS 2 376.407ms 416.973ms 1.50M 1.50M 33.68 MB 176.00 MB default.trip_fare_mid s
Change-Id: Ia53206fdd02bd72294f86ab9dd0b71b58303d33e
(cherry picked from commit 305bd5b54e8a35d894b32d36d2a4d54a2f4e300c)
---
M be/src/runtime/coordinator.cc
M be/src/runtime/data-stream-sender.cc
M be/src/util/summary-util.cc
M common/thrift/ExecStats.thrift
M shell/impala_client.py
5 files changed, 81 insertions(+), 42 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/79/2579/1
--
To view, visit http://gerrit.cloudera.org:8080/2579
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ia53206fdd02bd72294f86ab9dd0b71b58303d33e
Gerrit-PatchSet: 1
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Juan Yu <jy...@cloudera.com>