You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2018/06/07 19:05:02 UTC
[jira] [Commented] (NIFI-3497) ScanAttribute should support tagging
a flowfile with metadata value from the supplied dictionary
[ https://issues.apache.org/jira/browse/NIFI-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505102#comment-16505102 ]
ASF subversion and git services commented on NIFI-3497:
-------------------------------------------------------
Commit f5364875e82aa18aa157c0fedc152cf209110ba6 in nifi's branch refs/heads/master from [~joetrite]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=f536487 ]
Squashed commit of the following:
commit 9c31e45d3f94bf1e73c87379f315f6559e6a23f4
Author: Joe Trite <jo...@gmail.com>
Date: Mon Mar 13 07:55:19 2017 -0400
NIFI-1705 Adding AttributesToCSV processor
commit 5e9afa9ccf4276c7a2318b761ded77fd514a60d9
Merge: 3177eb185 74cbfc4b6
Author: Joe Trite <jo...@gmail.com>
Date: Sat Mar 4 08:12:39 2017 -0500
Merge remote-tracking branch 'origin/master'
# Conflicts:
# nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/ScanAttribute.java
commit 3177eb1852dbc7e70c250c53d038a5bcc5cfa3c5
Author: Joe Trite <jo...@gmail.com>
Date: Sat Mar 4 08:09:06 2017 -0500
NIFI-3497 Converted properties to use displayName, changed validator on demarcator property and created a method for duplicate code.
commit 74cbfc4b69ffde1ddb4442b91e160b66ea3c8b6b
Merge: a974f78e0 f8cad0f8c
Author: Joe Trite <jo...@gmail.com>
Date: Sat Mar 4 07:47:46 2017 -0500
Merge branch 'master' into master
commit a974f78e033885455cadd2cbffd7e387cbabc4d7
Author: Joe Trite <jo...@gmail.com>
Date: Sat Mar 4 07:43:02 2017 -0500
NIFI-3497 Converted properties to use displayName, changed validator on demarcator property and created a method for duplicate code.
commit 1bfaef8e87eaa6af84b1a80cb680e0a15eef2f8d
Merge: 65ed46de9 89ec68d14
Author: Joe Trite <jo...@gmail.com>
Date: Fri Mar 3 08:01:59 2017 -0500
Merge branch 'master' of https://github.com/joetrite/nifi
commit 65ed46de9a00518cfe06ecd69bd4f3bbd8d3e662
Author: Joe Trite <jo...@gmail.com>
Date: Fri Feb 24 18:09:36 2017 -0500
NIFI-3497 - fixing Pcontrib issues
commit c5d52cf6f0f16496d9ef83411770409c0b2f88d4
Author: Joe Trite <jo...@gmail.com>
Date: Thu Feb 23 10:19:01 2017 -0500
NIFI-3497 - excluding test files
Adding new test data files to exclude list.
commit b1959341138d3b5004979544fcea86ba36fe6ebb
Author: Joe Trite <jo...@gmail.com>
Date: Wed Feb 22 16:48:10 2017 -0500
NIFI-3497 - New dictionary files for test
Adding new dictionary files to support metadata dictionary option.
commit e296268f39bf213a9e8eaa8298b26556c6efe278
Author: Joe Trite <jo...@gmail.com>
Date: Wed Feb 22 16:46:13 2017 -0500
NIFI-3497 test cases for metadata updates
Adding test cases to support metadata option update.
commit de7e348e62c0f7c5fbd334106878ca6ac46935af
Author: Joe Trite <jo...@gmail.com>
Date: Wed Feb 22 16:36:08 2017 -0500
NIFI-3497 - Added metadata option
Added optional to post additional metadata as new attributed if a match is found in the dictionary.
commit 89ec68d14bb34cbe65ff9a4d50ff5321fd4ec0ef
Author: Joe Trite <jo...@gmail.com>
Date: Fri Feb 24 18:09:36 2017 -0500
NIFI-3497 - fixing Pcontrib issues
commit d71426037b142da8ca04dae38952c164d1614806
Author: Joe Trite <jo...@gmail.com>
Date: Thu Feb 23 10:19:01 2017 -0500
NIFI-3497 - excluding test files
Adding new test data files to exclude list.
commit a7a7b6ace80380416c342809ce95a4f4087bb066
Author: Joe Trite <jo...@gmail.com>
Date: Wed Feb 22 16:48:10 2017 -0500
NIFI-3497 - New dictionary files for test
Adding new dictionary files to support metadata dictionary option.
commit 8eb54a50193897cf564eb7d222aae35481168af4
Author: Joe Trite <jo...@gmail.com>
Date: Wed Feb 22 16:46:13 2017 -0500
NIFI-3497 test cases for metadata updates
Adding test cases to support metadata option update.
commit f52e1f2a064b31f87d4165af6075716fa7d55046
Author: Joe Trite <jo...@gmail.com>
Date: Wed Feb 22 16:36:08 2017 -0500
NIFI-3497 - Added metadata option
Added optional to post additional metadata as new attributed if a match is found in the dictionary.
NIFI-1705 Adding AttributesToCSV processor.
NIFI-1705 Adding AttributesToCSV processor.
NIFI-1705 Adding AttributesToCSV processor.
Signed-off-by: Matthew Burgess <ma...@apache.org>
This closes #2711
> ScanAttribute should support tagging a flowfile with metadata value from the supplied dictionary
> ------------------------------------------------------------------------------------------------
>
> Key: NIFI-3497
> URL: https://issues.apache.org/jira/browse/NIFI-3497
> Project: Apache NiFi
> Issue Type: Improvement
> Reporter: Joseph Witt
> Priority: Major
>
> Today ScanAttribute just looks through the supplied dictionary and given object for a string matching hit. If it hits then it is a match otherwise it is a 'not found'. However, when a hit occurs it can often be quite useful to gather additional metadata about that hit. This makes cases like enrichment/tagging much easier.
> So, plan is to have ScanAttribute support a dictionary value demarcator which would separate the dictionary term from some string response that will be added to the flowfile. For instance a dictionary might have
> apples:These are red or green
> bananas:These are yellow unless you should toss them or make bread
> Then if a hit occurs on 'apples' the flowfile that contained such an attribute would have a new attribute such as 'dictionary.hit.term' = 'apple' and 'dictionary.hit.metadata' = 'These are red or green'.
> This means downstream processors could extract that metadata and do interesting things with it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)