You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crunch.apache.org by "Matthias Friedrich (JIRA)" <ji...@apache.org> on 2012/07/21 10:47:34 UTC
[jira] [Created] (CRUNCH-21) Make temporary directory configurable
Matthias Friedrich created CRUNCH-21:
----------------------------------------
Summary: Make temporary directory configurable
Key: CRUNCH-21
URL: https://issues.apache.org/jira/browse/CRUNCH-21
Project: Crunch
Issue Type: Improvement
Components: Core
Affects Versions: 0.3.0
Reporter: Matthias Friedrich
Assignee: Matthias Friedrich
Priority: Minor
Fix For: 0.3.0
In pig it's possible to set the temporary directory using the pig.temp.dir property. Being able to redirect temporary output is useful in production systems to automatically clean up after aborted runs (or stuff accidentally left behind). We should have this in Crunch, too.
This is also a prerequisite for cleaning up the integration test suite. Right now it leaves 80 files behind on /tmp making it unsuitable for continuous integration in a shared environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CRUNCH-21) Make temporary directory configurable
Posted by "Josh Wills (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CRUNCH-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Josh Wills resolved CRUNCH-21.
------------------------------
Resolution: Fixed
Committed. Thanks Matthias!
> Make temporary directory configurable
> -------------------------------------
>
> Key: CRUNCH-21
> URL: https://issues.apache.org/jira/browse/CRUNCH-21
> Project: Crunch
> Issue Type: Improvement
> Components: Core
> Affects Versions: 0.3.0
> Reporter: Matthias Friedrich
> Assignee: Matthias Friedrich
> Priority: Minor
> Fix For: 0.3.0
>
> Attachments: 0001-CRUNCH-21-Make-temporary-dir-configurable.patch
>
>
> In pig it's possible to set the temporary directory using the pig.temp.dir property. Being able to redirect temporary output is useful in production systems to automatically clean up after aborted runs (or stuff accidentally left behind). We should have this in Crunch, too.
> This is also a prerequisite for cleaning up the integration test suite. Right now it leaves 80 files behind on /tmp making it unsuitable for continuous integration in a shared environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CRUNCH-21) Make temporary directory
configurable
Posted by "Matthias Friedrich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CRUNCH-21?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420115#comment-13420115 ]
Matthias Friedrich commented on CRUNCH-21:
------------------------------------------
First tiny feature, yay :)
> Make temporary directory configurable
> -------------------------------------
>
> Key: CRUNCH-21
> URL: https://issues.apache.org/jira/browse/CRUNCH-21
> Project: Crunch
> Issue Type: Improvement
> Components: Core
> Affects Versions: 0.3.0
> Reporter: Matthias Friedrich
> Assignee: Matthias Friedrich
> Priority: Minor
> Fix For: 0.3.0
>
> Attachments: 0001-CRUNCH-21-Make-temporary-dir-configurable.patch
>
>
> In pig it's possible to set the temporary directory using the pig.temp.dir property. Being able to redirect temporary output is useful in production systems to automatically clean up after aborted runs (or stuff accidentally left behind). We should have this in Crunch, too.
> This is also a prerequisite for cleaning up the integration test suite. Right now it leaves 80 files behind on /tmp making it unsuitable for continuous integration in a shared environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CRUNCH-21) Make temporary directory configurable
Posted by "Matthias Friedrich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CRUNCH-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias Friedrich updated CRUNCH-21:
-------------------------------------
Attachment: 0001-CRUNCH-21-Make-temporary-dir-configurable.patch
Hadoop has a property "hadoop.tmp.dir" so I suggest going with "crunch.tmp.dir" instead of Pig's "pig.temp.dir".
> Make temporary directory configurable
> -------------------------------------
>
> Key: CRUNCH-21
> URL: https://issues.apache.org/jira/browse/CRUNCH-21
> Project: Crunch
> Issue Type: Improvement
> Components: Core
> Affects Versions: 0.3.0
> Reporter: Matthias Friedrich
> Assignee: Matthias Friedrich
> Priority: Minor
> Fix For: 0.3.0
>
> Attachments: 0001-CRUNCH-21-Make-temporary-dir-configurable.patch
>
>
> In pig it's possible to set the temporary directory using the pig.temp.dir property. Being able to redirect temporary output is useful in production systems to automatically clean up after aborted runs (or stuff accidentally left behind). We should have this in Crunch, too.
> This is also a prerequisite for cleaning up the integration test suite. Right now it leaves 80 files behind on /tmp making it unsuitable for continuous integration in a shared environment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira