You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2014/10/13 23:51:34 UTC
[jira] [Resolved] (PIG-3482) Mapper only Jobs are not creating
intermediate files in /tmp/, instead of creating in user directory.
[ https://issues.apache.org/jira/browse/PIG-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Dai resolved PIG-3482.
-----------------------------
Resolution: Invalid
Close it for now since I didn't hear back from [~ravitejach], and I don't believe this is a problem. Feel free to open a new ticket if you still believe this is an issue and provide more detail.
> Mapper only Jobs are not creating intermediate files in /tmp/, instead of creating in user directory.
> ------------------------------------------------------------------------------------------------------
>
> Key: PIG-3482
> URL: https://issues.apache.org/jira/browse/PIG-3482
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.11.1
> Environment: RHEL 6.0
> Reporter: Raviteja Chirala
> Priority: Minor
> Fix For: 0.14.0
>
>
> When we run Mapper only jobs, All the intermediate outputs(compressed) are going to the user directory instead of going to tmp. If we run on small datasets, it shouldn't create a problem. But when I run for large datasets like more than 100TB lets say, it taking up so much disk space exceeding the disk space quota(setSpaceQuota) of 100GB also. Problem is happening before clean up.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)