You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2011/03/13 20:29:59 UTC
[jira] Updated: (PIG-1894) Worng stats shown when there are
multiple stores but same file names
[ https://issues.apache.org/jira/browse/PIG-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich updated PIG-1894:
--------------------------------
Fix Version/s: 0.9.0
Assignee: Richard Ding
Richard, I remember you already worked on an issue caused by the same name for output files. So this might already be solved but needs to be verified.
> Worng stats shown when there are multiple stores but same file names
> --------------------------------------------------------------------
>
> Key: PIG-1894
> URL: https://issues.apache.org/jira/browse/PIG-1894
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.8.0, 0.9.0
> Reporter: Vivek Padmanabhan
> Assignee: Richard Ding
> Fix For: 0.9.0
>
>
> Pig 0.8/0.9 shows wrong stats for store counters when I have multiple store but of the same name.
> To reproduce the issue please use the below script :
> {code}
> A = load 'sampledata1' as (f1:chararray,f2:chararray,f3:int);
> B = filter A by f3==1;
> C = filter A by f3==2;
> D = filter A by f3==3;
> store B into '/folder/B/out.gz';
> store C into '/folder/C/out.gz';
> store D into '/folder/D/out.gz';
> {code}
> Input
> {code}
> aaa a 1
> aaa b 1
> bbb a 2
> bbb b 2
> ccc a 3
> ccc b 3
> {code}
> For this script Pig shows
> Output(s):
> Successfully stored 6 records (32 bytes) in: "/folder/B/out.gz"
> Successfully stored 6 records (32 bytes) in: "/folder/C/out.gz"
> Successfully stored 6 records (32 bytes) in: "/folder/D/out.gz"
> Counters:
> Total records written : 18
> Total bytes written : 96
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira