high task count

[Mark Bean <ma...@gmail.com>]

We have a PostHTTP with the failure relationship going to a downstream
processor. The downstream processor has a huge task count - over 100
million tasks across the cluster in the 5-minute stats window. Yet, there
are only between 4,000-18,000 FlowFiles that are processed in that same
time.

The exact downstream processor does not change the behavior. Three separate
processor types were added as the next downstream processor to the original
PostHTTP - one of them a simple UpdateAttribute that did not update any
attributes - and each downstream processor exhibited the same unusually
high task count.

Any ideas on why there are so many tasks executing for this particular
connection?