You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crunch.apache.org by "Josh Wills (JIRA)" <ji...@apache.org> on 2013/04/29 08:28:16 UTC

[jira] [Updated] (CRUNCH-200) Move the logic for handling job outputs from CrunchJobHooks into the PathTarget objects

     [ https://issues.apache.org/jira/browse/CRUNCH-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Wills updated CRUNCH-200:
------------------------------

    Attachment: CRUNCH-200.patch

Something like this does what I want.
                
> Move the logic for handling job outputs from CrunchJobHooks into the PathTarget objects
> ---------------------------------------------------------------------------------------
>
>                 Key: CRUNCH-200
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-200
>             Project: Crunch
>          Issue Type: Improvement
>            Reporter: Josh Wills
>         Attachments: CRUNCH-200.patch
>
>
> Certain output formats, like Trevni, have a non-standard output file format that requires custom handling logic. Currently, the logic for moving the output of a Crunch job from a temporary place on the filesystem to its final output directory is handled by logic in CrunchJobHooks, but the actual work of moving the files should be delegated to the Target object, which will be aware of how the files are laid out in the filesystem and can move them appropriately.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira