You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "Andrew Christianson (JIRA)" <ji...@apache.org> on 2017/04/28 12:10:04 UTC

[jira] [Commented] (MINIFI-244) Create FocusArchive processor

    [ https://issues.apache.org/jira/browse/MINIFI-244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15988715#comment-15988715 ] 

Andrew Christianson commented on MINIFI-244:
--------------------------------------------

Just a quick update on this. The processors are developed and pushed to https://github.com/achristianson/nifi-minifi-cpp/tree/MINIFI-244, but there is going to be merging work and ideally work on unit tests before I can turn it into a proper pull request. Feel free to take an early look.

> Create FocusArchive processor
> -----------------------------
>
>                 Key: MINIFI-244
>                 URL: https://issues.apache.org/jira/browse/MINIFI-244
>             Project: Apache NiFi MiNiFi
>          Issue Type: Task
>          Components: C++, Extensions
>            Reporter: Andrew Christianson
>            Assignee: Andrew Christianson
>            Priority: Minor
>
> Create an FocusArchive processor which implements a lens over an archive (tar, etc.). A concise, though informal, definition of a lens is as follows:
> "Essentially, they represent the act of “peering into” or “focusing in on” some particular piece/path of a complex data object such that you can more precisely target particular operations without losing the context or structure of the overall data you’re working with." https://medium.com/@dtipson/functional-lenses-d1aba9e52254#.hdgsvbraq
> Why an FocusArchive in MiNiFi? Simply put, it will enable us to "focus in on" an entry in the archive, perform processing *in-context* of that entry, then re-focus on the overall archive. This allows for transformation or other processing of an entry in the archive without losing the overall context of the archive.
> Initial format support is tar, due to its simplicity and ubiquity.
> Attributes:
> - Path (the path in the archive to focus; "/" to re-focus the overall archive)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)