[jira] [Created] (NIFI-8219) PMEM-backed Repositories

["Takashi Menjo (Jira)" <ji...@apache.org>]

Takashi Menjo created NIFI-8219:
-----------------------------------

             Summary: PMEM-backed Repositories
                 Key: NIFI-8219
                 URL: https://issues.apache.org/jira/browse/NIFI-8219
             Project: Apache NiFi
          Issue Type: New Feature
          Components: Core Framework
         Environment: PMEM, x64, Linux, DAX, PMDK
            Reporter: Takashi Menjo


Persistent memory (PMEM) is non-volatile and byte-addressable memory installed into DIMM slots. With Filesystem DAX (Direct Access) and PMDK (Persistent Memory Development Kit), a program can map on-PMEM files to userspace then read and write its data, bypassing page caches. These technologies could bring you better I/O performance than traditional disks.

I would propose a patchset that lets FlowFile, Content, and Provenance Repositories use PMDK (via JNI) to write their data to their files shown as follows:

 * FlowFile Repository: Journals (.journal)
 * Content Repository: Content/Resource Claims
 * Provenance Repository: Provenance logs (.prov) and ToCs (.toc)

*Please note that this patchset works only on x64 Linux (4.15 or later) for now.*



--
This message was sent by Atlassian Jira
(v8.3.4#803005)