You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2015/02/11 19:29:12 UTC

[jira] [Resolved] (PIG-2554) /tmp/temp* pig temporary directories should be unique.

     [ https://issues.apache.org/jira/browse/PIG-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy resolved PIG-2554.
-------------------------------------
    Resolution: Duplicate

This issue has been fixed in PIG-3874 by retrying if directory already exists during creation.

> /tmp/temp* pig temporary directories should be unique.
> ------------------------------------------------------
>
>                 Key: PIG-2554
>                 URL: https://issues.apache.org/jira/browse/PIG-2554
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0, 0.9.1
>            Reporter: Mitesh Singh Jat
>
> The /tmp/temp* directory is generated using Random.nextInt(). The collision of the random integers generated may occur. This issue was seen quite a few times.
> {noformat}
> 4418 [main] ERROR org.apache.pig.tools.grunt.Grunt  - You don't have permission to perform the operation. Error from
> the server: org.apache.hadoop.security.AccessControlException: Permission denied: user=user1, access=EXECUTE,
> inode="temp-1980965992":user2:hdfs:rwx------
> 4419 [main] ERROR org.apache.pig.tools.grunt.Grunt  - ERROR 6007: Unable to check name
> hdfs://nn1/tmp/temp-1980965992/tmp-33521837
> 4430 [main] ERROR org.apache.pig.impl.io.FileLocalizer  - org.apache.hadoop.security.AccessControlException:
> org.apache.hadoop.security.AccessControlException: Permission denied: user=user1, access=ALL,
> inode="temp-1980965992":user2:hdfs:rwx------
> {noformat}
> A workaround is to change the base directory(for some group) *pig.temp.dir* to avoid this rare conflict.
> for example:
> {noformat}
> pig -Dpig.temp.dir=/tmp/$USER/$RANDOM pig_script.pig
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)