You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by preethini v <pr...@gmail.com> on 2017/05/25 14:31:45 UTC
Wrong Stats obtained | transferred count | Storm UI
Hi,
I am studying Storm performance. When I run a simple wordcount for 5 mins,
the number of transferred shown in Storm UI is "transferred":341640 . I
modified my code to fetch the transferred value from TopologyInfo. I
number of transferred obtained from this is 44,780.
Why is there so much difference among these values?
Does "transferred" value that we see in Storm UI indicate the number of
tuples processed by Storm or anything else?
Any inputs is greatly appreciated. Thanks.
Code changes for fetching transferred value as below,
TopologyInfo info = client.getTopologyInfo(id);
for (ExecutorSummary exec : info.get_executors()) {
if ("spout".equals(exec.get_component_id()) && exec.get_stats() != null
&& exec.get_stats().get_specific() != null) {
ExecutorStats statsT = exec.get_stats();
Map<String, Map<String, Long>> numtransferred = statsT.get_transferred();
if (numtransferred != null) {
Map<String, Long> e2 = numtransferred.get(":all-time");
if (e2 != null) {
Long dflt = e2.get("default");
if (dflt != null) {
totalTransferred += dflt;
}
}
}
}
}