You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2016/05/23 16:30:12 UTC

[jira] [Updated] (PIG-4908) JythonFunction refers to Oozie launcher script absolute path

     [ https://issues.apache.org/jira/browse/PIG-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy updated PIG-4908:
------------------------------------
    Attachment: PIG-4908-1.patch

> JythonFunction refers to Oozie launcher script absolute path
> ------------------------------------------------------------
>
>                 Key: PIG-4908
>                 URL: https://issues.apache.org/jira/browse/PIG-4908
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.16.0
>
>         Attachments: PIG-4908-1.patch
>
>
>   We had a scenario where a user had multiple udfs all named udfs.py. JythonFunction was referring to the absolute localized path of udfs.py in the Oozie launcher. Tasks which ran on a node and which had a different version of udfs.py localized to same path (hashcode conflict) as the Oozie launcher failed.  We should be referring to relative path of the files. The current code check is the canonical path starts with cwd, but that does not work as the files are downloaded to a different location and symlinked to the current working directory of the task attempt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)