You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Tanmoy (JIRA)" <ji...@apache.org> on 2017/11/10 11:09:00 UTC

[jira] [Created] (NIFI-4596) The FetchDistributedMapCache processor should read the flowfile attributes from the previous processor

Tanmoy created NIFI-4596:
----------------------------

             Summary: The FetchDistributedMapCache processor should read the flowfile attributes from the previous processor
                 Key: NIFI-4596
                 URL: https://issues.apache.org/jira/browse/NIFI-4596
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
    Affects Versions: 1.2.0
         Environment: Nifi running on a 3-node cluster. OS - CentOS
            Reporter: Tanmoy
            Priority: Minor


The FetchDistributedMapCache processor should read the flowfile attributes from the previous processor. In that case, we can configure which Cache Entry Identifier to read from. Right now, the processor accepts only static labels. Hence, it cannot be used in a framework where we would like to have the input source name in the Cache Identifier. The PutDistributedMapCache does not have any such restricition.

Current usecase: I am reading my config from HDFS and each time a flow file appears in SFTP server, I ingest them using my framework. Processing time can be improved if I used the cache. But, the FetchDistributedMapCache is not configured to accept flowfile attributes as Cache Identifier. This limits its usage as Filenames vary everytime.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)