[jira] [Commented] (NIFI-8113) Persisting status history

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17291228#comment-17291228 ] 

ASF subversion and git services commented on NIFI-8113:
-------------------------------------------------------

Commit 7730777d6632590b5433442bcf90b495a1da97ee in nifi's branch refs/heads/main from Bence Simon
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=7730777 ]

NIFI-8113 Adding persistent status history repository backed by embedded QuestDB

Signed-off-by: Mark Payne <ma...@hotmail.com>


> Persisting status history
> -------------------------
>
>                 Key: NIFI-8113
>                 URL: https://issues.apache.org/jira/browse/NIFI-8113
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Core Framework
>            Reporter: Simon Bence
>            Assignee: Simon Bence
>            Priority: Major
>          Time Spent: 4h
>  Remaining Estimate: 0h
>
> An alternative solution would be useful to replace/extend current in-memory solution for storing component and node metrics. This is in order to ease heap usage of NiFi which in case of high amount of processors (10-20k) might be significant and also to keep system information after shutting down.
> The solution should keep the data even if NiFi is stopped running and make it possible to read it out. It should be optimised for writing data as reading is much less frequent.
>  
> Proposal:
>  * Use QuestDB as backend
>  * Add a new implementation for ComponentStatusRepository
>  * Making it interchangeable between the existing and upcoming solutions
>  * Provide some rollback policy in order to avoid ever-growing database



--
This message was sent by Atlassian Jira
(v8.3.4#803005)