[jira] [Resolved] (CRUNCH-449) Add sequentialDo function for injecting arbitrary non-parallel code

["Josh Wills (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CRUNCH-449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Wills resolved CRUNCH-449.
-------------------------------

       Resolution: Fixed
    Fix Version/s: 0.11.0
                   0.8.4

Pushed to master and 0.8. Thanks again, [~gabriel.reid] and [~mkwhitacre]!

> Add sequentialDo function for injecting arbitrary non-parallel code
> -------------------------------------------------------------------
>
>                 Key: CRUNCH-449
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-449
>             Project: Crunch
>          Issue Type: Bug
>          Components: Core
>            Reporter: Josh Wills
>            Assignee: Josh Wills
>             Fix For: 0.8.4, 0.11.0
>
>         Attachments: CRUNCH-449.patch, CRUNCH-449b.patch, CRUNCH-449c.patch, CRUNCH-449d.patch, CRUNCH-449e.patch
>
>
> I've been noodling on this one for awhile: how to add the ability to execute some code if and only if one or more targets are created, and have that executed code (optionally) return one or more new PCollections as a result. I was thinking that this functionality could be wired in to libraries to do things like bulk loading HBase tables or running Sqoop jobs as part of Crunch pipelines automatically.



--
This message was sent by Atlassian JIRA
(v6.2#6252)