You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Cheolsoo Park (JIRA)" <ji...@apache.org> on 2013/01/27 22:59:13 UTC

[jira] [Updated] (PIG-2266) bug with input file joining optimization in Pig

     [ https://issues.apache.org/jira/browse/PIG-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Cheolsoo Park updated PIG-2266:
-------------------------------

    Attachment: PIG-2266.patch

Attaching Joe's change as a patch. This is needed for PIG-3015.
                
> bug with input file joining optimization in Pig
> -----------------------------------------------
>
>                 Key: PIG-2266
>                 URL: https://issues.apache.org/jira/browse/PIG-2266
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.9.0, 0.10.0
>            Reporter: Joseph Adler
>         Attachments: PIG-2266.patch
>
>
> In src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java, the function hasTooManyInputFiles instantiated a LoadFunc instance, then calls setLocation before calling setUDFContextSignature. This is inconsistent with the documentation for the LoadFunc interface (see http://pig.apache.org/docs/r0.9.0/api/org/apache/pig/LoadFunc.html#setUDFContextSignature(java.lang.String)). (We've written UDFs that assume that setUDFContextSignature is called first.)
> I think you can fix this by adding 
>    loader.setUDFContextSignature(ld.getSignature());
> Before
>    loader.setLocation(location, job);

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira