You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by prabhu Mahendran <pr...@gmail.com> on 2017/02/11 04:42:57 UTC

Is this possible to increase speed of processors in NiFi?

Since each processor have concurrent tasks if i have set the concurrent
tasks for processors then it boosts processing speed of processors.But it
affects the System performance such as 100% Disk Usage,100% Memory
Usage..etc

Is there is any other way to speed up processors without use concurrent
tasks?

Re: Is this possible to increase speed of processors in NiFi?

Posted by Joe Witt <jo...@gmail.com>.
For processors that support it consider using a 'run duration of 25
milliseconds'.  This allows the framework to batch many operations
into fewer transactions which can dramatically increase throughput.

100% memory usage is a problem.  Increase heap size or consider
redesign/simplifying your flow.

100% disk usage should be addressed.  Ensure each repository is on a
physically separate partition.  If this is not possible then keep in
mind they will create congestion for eachother or consider switching
to a volatile provenance repository.

Review the flow for processors which load content fully into memory.
This can harm performance greatly.

On Fri, Feb 10, 2017 at 11:42 PM, prabhu Mahendran
<pr...@gmail.com> wrote:
>
> Since each processor have concurrent tasks if i have set the concurrent
> tasks for processors then it boosts processing speed of processors.But it
> affects the System performance such as 100% Disk Usage,100% Memory
> Usage..etc
>
> Is there is any other way to speed up processors without use concurrent
> tasks?