You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Richard Ding (JIRA)" <ji...@apache.org> on 2011/02/17 21:59:12 UTC

[jira] Updated: (PIG-1779) Worng stats shown when there are multiple loads but same file names

     [ https://issues.apache.org/jira/browse/PIG-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Richard Ding updated PIG-1779:
------------------------------

    Attachment: PIG-1779.patch

Output of test-patch:

{code}
    [exec] +1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 3 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
     [exec] 
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec] 
     [exec]     +1 release audit.  The applied patch does not increase the total number of release audit warnings.
{code}

> Worng stats shown when there are multiple loads but same file names
> -------------------------------------------------------------------
>
>                 Key: PIG-1779
>                 URL: https://issues.apache.org/jira/browse/PIG-1779
>             Project: Pig
>          Issue Type: Bug
>          Components: tools
>    Affects Versions: 0.8.0
>            Reporter: Vivek Padmanabhan
>            Assignee: Richard Ding
>             Fix For: 0.9.0
>
>         Attachments: PIG-1779.patch
>
>
> In Pig 0.8 , the stats is showing wrong information when ever I have multiple loads and the the file names are similar .
> a) Problem 1
> Sample Script : 
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/anotherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here I have 10 records for A and 3 records for B , but pig says 
> Successfully read 6 records from: "<nn>/myfolder/anotherfolder/tryme"
> Successfully read 6 records from: "<nn>myfolder/tryme"
> b) Problem 2
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/an1111otherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here there is no folder named an1111otherfolder while "myfolder/tryme" exists . But pig says
> Failed to read data from "<nn>/myfolder/an1111otherfolder/tryme"
> Failed to read data from "<nn>/myfolder/tryme"

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira