You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2011/03/13 20:29:59 UTC

[jira] Updated: (PIG-1894) Worng stats shown when there are multiple stores but same file names

     [ https://issues.apache.org/jira/browse/PIG-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich updated PIG-1894:
--------------------------------

    Fix Version/s: 0.9.0
         Assignee: Richard Ding

Richard, I remember you already worked on an issue caused by the same name for output files. So this might already be solved but needs to be verified.

> Worng stats shown when there are multiple stores but same file names
> --------------------------------------------------------------------
>
>                 Key: PIG-1894
>                 URL: https://issues.apache.org/jira/browse/PIG-1894
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Vivek Padmanabhan
>            Assignee: Richard Ding
>             Fix For: 0.9.0
>
>
> Pig 0.8/0.9 shows wrong stats for store counters when I have multiple store but of the same name.
> To reproduce the issue please use the below script :
> {code}
> A = load 'sampledata1' as (f1:chararray,f2:chararray,f3:int);
> B = filter A by f3==1;
> C = filter A by f3==2;
> D = filter A by f3==3;
> store B into '/folder/B/out.gz';
> store C into '/folder/C/out.gz';
> store D into '/folder/D/out.gz';
> {code}
> Input 
> {code}
> aaa     a       1
> aaa     b       1
> bbb     a       2
> bbb     b       2
> ccc     a       3
> ccc     b       3
> {code}
> For this script Pig shows 
> Output(s):
> Successfully stored 6 records (32 bytes) in: "/folder/B/out.gz"
> Successfully stored 6 records (32 bytes) in: "/folder/C/out.gz"
> Successfully stored 6 records (32 bytes) in: "/folder/D/out.gz"
> Counters:
> Total records written : 18
> Total bytes written : 96

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira