You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by prabhu Mahendran <pr...@gmail.com> on 2017/02/11 04:42:57 UTC
Is this possible to increase speed of processors in NiFi?
Since each processor have concurrent tasks if i have set the concurrent
tasks for processors then it boosts processing speed of processors.But it
affects the System performance such as 100% Disk Usage,100% Memory
Usage..etc
Is there is any other way to speed up processors without use concurrent
tasks?
Re: Is this possible to increase speed of processors in NiFi?
Posted by Joe Witt <jo...@gmail.com>.
For processors that support it consider using a 'run duration of 25
milliseconds'. This allows the framework to batch many operations
into fewer transactions which can dramatically increase throughput.
100% memory usage is a problem. Increase heap size or consider
redesign/simplifying your flow.
100% disk usage should be addressed. Ensure each repository is on a
physically separate partition. If this is not possible then keep in
mind they will create congestion for eachother or consider switching
to a volatile provenance repository.
Review the flow for processors which load content fully into memory.
This can harm performance greatly.
On Fri, Feb 10, 2017 at 11:42 PM, prabhu Mahendran
<pr...@gmail.com> wrote:
>
> Since each processor have concurrent tasks if i have set the concurrent
> tasks for processors then it boosts processing speed of processors.But it
> affects the System performance such as 100% Disk Usage,100% Memory
> Usage..etc
>
> Is there is any other way to speed up processors without use concurrent
> tasks?