1 minutes vs 5 minutes Metrics via Prometheus

["Jens M. Kofoed" <jm...@gmail.com>]

We are looking into getting metrics from NIFI into grafana via Prometheus.
It seems the metrics reported are the 5 minutes stats and not the 1 minutes
snap. If we look at the status history of a processor we can see that the
history is shown in a 1 minutes interval. I know the stat on the processor
is showing the last 5 minutes and it seems like it is the same 5
minutes stat that is being reported at the metrics instead of the 1 minutes
snap.

Is it possible to configure the Prometheus reporting task to report the 1
minutes snap instead?

kind regards
Jens M. Kofoed

Re: 1 minutes vs 5 minutes Metrics via Prometheus

[jmkofoed <jm...@gmail.com>]

Hi

Now I have checked all metrics and the following metrics have values going
from 0 up to X and back to 0 within 3 scrapings:
nifi_amount_items_queued
nifi_amount_threads_active
nifi_percent_used_bytes
nifi_percent_used_count
nifi_size_content_queued_total
nifi_transmitting

The following metrics have been checked with flows with 1-2 files per 10
minutes. These shows the same values for 5 minutes however if there are many
files they show changes at every scrap (15s). but still one file is
effecting the value for 5 minutes.
nifi_amount_bytes_read
nifi_amount_bytes_received
nifi_amount_bytes_sent
nifi_amount_bytes_transferred
nifi_amount_bytes_written
nifi_amount_flowfiles_received
nifi_amount_flowfiles_removed
nifi_amount_flowfiles_sent
nifi_amount_flowfiles_transferred
nifi_amount_items_input
nifi_amount_items_output
nifi_average_lineage_duration
nifi_size_content_input_total
nifi_size_content_output_total
nifi_total_bytes_read
nifi_total_bytes_written

kind regards
Jens M. Kofoed



--
Sent from: http://apache-nifi-users-list.2361937.n4.nabble.com/

Re: 1 minutes vs 5 minutes Metrics via Prometheus

[jmkofoed <jm...@gmail.com>]

Hi again,

This is a bit more complex because I see some metrics change every time
Prometheus is scraping (15 sec.)
The following metrics is updated frequently:
nifi_size_content_queued_total
nifi_amount_items_queued
nifi_amount_items_output
nifi_amount_bytes_received

But if the rate of flowfiles is very low (1 every 5-10 minutes)
nifi_size_content_input_total is showing the same value for 5 minutes. The
value change then new files arrived to the process (about every 1 minutes)
but the values looks like it comes from the 5 minutes stat. Not like the
metrics above.

kind regards
Jens M. Kofoed



--
Sent from: http://apache-nifi-users-list.2361937.n4.nabble.com/