You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by preethini v <pr...@gmail.com> on 2017/05/25 14:31:45 UTC

Wrong Stats obtained | transferred count | Storm UI

Hi,

I am studying Storm performance. When I run a simple wordcount for 5 mins,
the number of transferred shown in Storm UI is "transferred":341640 . I
modified my code to fetch the transferred  value from TopologyInfo. I
number of transferred obtained from this is 44,780.

Why is there so much difference among these values?
Does "transferred"  value that we see in Storm UI indicate the number of
tuples processed by Storm or anything else?

Any inputs is greatly appreciated. Thanks.

Code changes for fetching transferred value as below,
TopologyInfo info = client.getTopologyInfo(id);
for (ExecutorSummary exec : info.get_executors()) {
if ("spout".equals(exec.get_component_id()) && exec.get_stats() != null
&& exec.get_stats().get_specific() != null) {
ExecutorStats statsT = exec.get_stats();
Map<String, Map<String, Long>> numtransferred = statsT.get_transferred();
if (numtransferred != null) {
Map<String, Long> e2 = numtransferred.get(":all-time");
if (e2 != null) {
Long dflt = e2.get("default");
if (dflt != null) {
totalTransferred += dflt;
}
}
}
}
}