You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/09/22 15:06:21 UTC

[jira] [Commented] (NIFI-2805) Add fragment attributes for SplitAvro

    [ https://issues.apache.org/jira/browse/NIFI-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513523#comment-15513523 ] 

ASF GitHub Bot commented on NIFI-2805:
--------------------------------------

GitHub user mattyb149 opened a pull request:

    https://github.com/apache/nifi/pull/1046

    NIFI-2805: Add fragment attributes to SplitAvro

    Same idea as #919 but for SplitAvro

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mattyb149/nifi NIFI-2805

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/nifi/pull/1046.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1046
    
----
commit a7b165d4b42961b7eb5cc2b1b6ed99ef6bc33521
Author: Matt Burgess <ma...@apache.org>
Date:   2016-09-22T15:00:11Z

    NIFI-2805: Add fragment attributes to SplitAvro

----


> Add fragment attributes for SplitAvro
> -------------------------------------
>
>                 Key: NIFI-2805
>                 URL: https://issues.apache.org/jira/browse/NIFI-2805
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Matt Burgess
>            Assignee: Matt Burgess
>
> Some "splitting" processors such as SplitText and SplitContent write attributes to the split flow files indicating their fragment index, the total count, and the filename of the original flow file. This is done to support a form of "micro-batching" and/or a split-join pattern in a data flow (i.e. split the original file, do work on the individual pieces, and possibly merge them together later).
> For consistency and capability, the SplitAvro processor should write these same attributes for its split flow files.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)