[jira] Updated: (PIG-1779) Worng stats shown when there are multiple loads but same file names

["Richard Ding (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Richard Ding updated PIG-1779:
------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Patch committed to trunk.

> Worng stats shown when there are multiple loads but same file names
> -------------------------------------------------------------------
>
>                 Key: PIG-1779
>                 URL: https://issues.apache.org/jira/browse/PIG-1779
>             Project: Pig
>          Issue Type: Bug
>          Components: tools
>    Affects Versions: 0.8.0
>            Reporter: Vivek Padmanabhan
>            Assignee: Richard Ding
>             Fix For: 0.9.0
>
>         Attachments: PIG-1779.patch
>
>
> In Pig 0.8 , the stats is showing wrong information when ever I have multiple loads and the the file names are similar .
> a) Problem 1
> Sample Script : 
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/anotherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here I have 10 records for A and 3 records for B , but pig says 
> Successfully read 6 records from: "<nn>/myfolder/anotherfolder/tryme"
> Successfully read 6 records from: "<nn>myfolder/tryme"
> b) Problem 2
> A = LOAD 'myfolder/tryme' AS (f1);
> B = LOAD 'myfolder/an1111otherfolder/tryme' AS (f2);
> C = JOIN A BY f1, B BY f2;
> DUMP C;
> Here there is no folder named an1111otherfolder while "myfolder/tryme" exists . But pig says
> Failed to read data from "<nn>/myfolder/an1111otherfolder/tryme"
> Failed to read data from "<nn>/myfolder/tryme"

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira