You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2019/12/19 20:05:00 UTC
[jira] [Commented] (IMPALA-4618) # hosts is inaccurate in exec
summary when mt_dop > 0
[ https://issues.apache.org/jira/browse/IMPALA-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000336#comment-17000336 ]
ASF subversion and git services commented on IMPALA-4618:
---------------------------------------------------------
Commit 4d9d6b49566cd99a06cf6bd4f1d202b7cfedead8 in impala's branch refs/heads/master from Tim Armstrong
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=4d9d6b4 ]
Fix bug in report_benchmark_results.py
This was introduced by IMPALA-4618.
Exception was:
Traceback (most recent call last):
File "tests/benchmark/report_benchmark_results.py", line 1135, in <module>
report = Report(grouped, ref_grouped)
File "tests/benchmark/report_benchmark_results.py", line 494, in __init__
self.__analyze()
File "tests/benchmark/report_benchmark_results.py", line 517, in __analyze
query_variability_row = Report.QueryVariabilityRow(results, ref_results)
File "tests/benchmark/report_benchmark_results.py", line 480, in __init__
results, ref_results, for_variability = True)
File "tests/benchmark/report_benchmark_results.py", line 1095, in build_exec_summary_str
return str(comparison) + '\n'
File "tests/benchmark/report_benchmark_results.py", line 844, in __str__
return str(self.__build_table_variability())
File "tests/benchmark/report_benchmark_results.py", line 891, in __build_table_variability
output += str(self.combined_summary) + '\n'
File "tests/benchmark/report_benchmark_results.py", line 713, in __str__
table.add_row(table_row)
File "/home/tarmstrong/Impala/incubator-impala/infra/python/env/local/lib/python2.7/site-packages/prettytable.py", line 818, in add_row
raise Exception("Row has incorrect number of values, (actual) %d!=%d (expected)" %(len(row),len(self._field_names)))
Exception: Row has incorrect number of values, (actual) 8!=7 (expected)
Change-Id: I6a163e74fefc896464e35a6a1b91ce57de592f1a
Reviewed-on: http://gerrit.cloudera.org:8080/14925
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> # hosts is inaccurate in exec summary when mt_dop > 0
> -----------------------------------------------------
>
> Key: IMPALA-4618
> URL: https://issues.apache.org/jira/browse/IMPALA-4618
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 2.8.0
> Reporter: Tim Armstrong
> Assignee: Norbert Luksa
> Priority: Major
> Labels: multithreading, ramp-up, supportability
> Fix For: Impala 3.4.0
>
>
> I'm seeing this on a 3-node minicluster:
> {code}
> Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail
> -------------------------------------------------------------------------------------------------------------
> 06:AGGREGATE 1 212.433us 212.433us 0 1 64.00 B -1.00 B FINALIZE
> 05:EXCHANGE 1 0.000ns 0.000ns 0 1 0 -1.00 B UNPARTITIONED
> 02:AGGREGATE 9 131.439us 167.821us 0 1 64.00 B 10.00 MB
> 04:AGGREGATE 9 0.000ns 0.000ns 0 -1 183.42 MB 128.00 MB
> 03:EXCHANGE 9 707.426ms 823.681ms 20.97M -1 0 0 HASH(`_c0`)
> 01:AGGREGATE 9 5s222ms 5s355ms 22.89M -1 3.83 MB 128.00 MB STREAMING
> 00:SCAN HDFS 9 2s623ms 2s896ms 23.33M -1 492.02 KB 88.00 MB default.big_uuids
> {code}
> It seems like it's reporting the # of fragment instances instead of the number of hosts.
> We should probably report both #Hosts and #Instances if mt_dop is enabled (and maybe in all cases)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org